ai techniques in matlab for signal, time-series, and text data€¦ · ai and deep learning for...
TRANSCRIPT
![Page 1: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/1.jpg)
1© 2015 The MathWorks, Inc.
First name and surname
AI Techniques in MATLAB for
Signal, Time-Series, and Text Data
![Page 2: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/2.jpg)
2
AI and Deep Learning for Signals in the News
Deep Learning developed and evolved for image
processing and computer vision applications.
It is now increasingly and successfully used
on signals and time series
![Page 3: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/3.jpg)
3
Communications devices,
security
Aerospace, Defense and Communications Consumer Electronics and Digital Health
Condition monitoring
Multi-standard communications
receivers, drone recognition
Automotive
Voice control enabled
Infotainment
Voice assistants
Sensor processing,
automated driving
Digital health
Industrial Automation
Predictive maintenance
The Use of Deep Learning is Growing Across Industries
![Page 4: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/4.jpg)
4
Application Examples Using MATLAB – Audio and Speech
Speech Command Recognition
(a.k.a. "Keyword Spotting")
https://www.mathworks.com/help/deeplearning/e
xamples/deep-learning-speech-recognition.html
Music Genre Classification
https://www.mathworks.com/help/audio/examples/music-
genre-classification-using-wavelet-time-scattering.html
![Page 5: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/5.jpg)
5
Application Examples Using MATLAB – Industrial and
physiological sensors
Human Activity Recognition
https://www.mathworks.com/help/deeplearning/examples/seq
uence-to-sequence-classification-using-deep-learning.html
ECG Signal Classification
https://www.mathworks.com/help/signal/examples/classify-
ecg-signals-using-long-short-term-memory-networks.html
![Page 6: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/6.jpg)
6
Application Examples Using MATLAB – Radar and
Communications
Modulation Classification
http://www.mathworks.com/help/comm/examples/
modulation-classification-with-deep-learning.html
![Page 7: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/7.jpg)
7
Agenda
▪ Deep Learning – Basic ideas
▪ Deep Learning Model Development for Signals, Time Series, and Text
▪ Conclusions
![Page 8: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/8.jpg)
8
Deep learning is a type of machine learning in which a model learns from examples.
What is Deep Learning?
![Page 9: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/9.jpg)
9
Common Network Architectures - Signal Processing
Feature Engineering
Time-Frequency Transformation
Convolutional Neural Networks (CNN)
Long Short Term Memory (LSTM) Networks
![Page 10: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/10.jpg)
10
Common Network Architectures – Text Analytics
Feature Engineering
Convolutional Neural Networks (CNN)
Long Short Term Memory (LSTM) Networks
Feature Engineering
![Page 11: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/11.jpg)
11
Deep Learning Workflow
Data sources
Data Labeling
CREATE AND ACCESS
DATASETS
DEVELOP PREDICTIVE
MODELS
PREPROCESS AND
TRANSFORM DATA
Feature extraction
ACCELERATE AND
DEPLOY
Embedded Devices and
Hardware
Simulation and
augmentation
Analyze and tune
hyperparameters
Import Reference Models/
Design from scratch
Transformation Hardware-Accelerated
Training
Pre-Processing Desktop Apps
Enterprise Scale Systems
![Page 12: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/12.jpg)
12
Deep Learning Workflow Challenges – Signals and Time Series
Data Labeling
Deep learning models only as
good as
training data
Limited Data
Availabiliy
Domain-specific data
processing desirable
Limited reference
research
Deployment and
Scaling to various
platforms
![Page 13: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/13.jpg)
13
Agenda
▪ Deep Learning – Basic ideas
▪ Deep Learning Model Development for Signals, Time Series, and Text
– Data
– Processing and transformation
– Model design and optimization
– Acceleration, prototyping, and deployment
▪ Conclusions
![Page 14: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/14.jpg)
14
Agenda
▪ Deep Learning – Basic ideas
▪ Deep Learning Model Development for Signals, Time Series, and Text
– Data
– Processing and transformation
– Model design and optimization
– Acceleration, prototyping, and deployment
▪ Conclusions
![Page 15: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/15.jpg)
15
Current Investments – Models vs. Data
From "Troubleshooting deep neural networks" (Josh Tobin et al., Jan 2019)
Research
Models andAlgorithms
Datasets
Industry
![Page 16: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/16.jpg)
16
What does a large dataset look like?
How to navigate, index, read (aka "ingest") a large dataset?
How to...
▪ Build a list of all data and labels?
▪ Review basic statistics about available data?
▪ Select data subsets without nested for
loops, dir, ls, what, ... aplenty?
▪ Jointly read data and labels?
▪ Automatically distribute computations?
audioDatastore
fileDatastore
imageDatastore
Custom Datastores
![Page 17: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/17.jpg)
17
Label quality impacts model performance as much as the
quality and quantity of the actual recordings
![Page 18: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/18.jpg)
18
Use appropriate tools to help you label signals
▪ Programmatically… ▪ … or via Apps
![Page 19: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/19.jpg)
19
What if available data isn't enough?
Original
Original
Dataset
Augmented
Dataset
N times as
much data
Data augmentation allows building
more complex and more robust models
Pitch shift
![Page 20: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/20.jpg)
20
Simulation is key if recording and labelling real-world data is
impractical or unreasonable – Communications Signals
![Page 21: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/21.jpg)
21
Simulation is key if recording and labelling real-world data is
impractical or unreasonable – Radar Signals
Micro-Doppler AnalysisRadar Target Simulation
![Page 22: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/22.jpg)
22
Agenda
▪ Deep Learning – Basic ideas
▪ Deep Learning Model Development for Signals, Time Series, and Text
– Data
– Processing and transformation
– Model design and optimization
– Acceleration, prototyping, and deployment
▪ Conclusions
![Page 23: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/23.jpg)
23
Common types of network architectures used in signal processing
and text analytics applications
Feature Engineering
Time-Frequency Transformation
Convolutional Neural Networks (CNN)
Long Short Term Memory (LSTM) Networks
![Page 24: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/24.jpg)
24
Time-Frequency Transformations
Time (samples) Time (frame #)
freq
ue
nc
y (
bin
#)
Tim
e (
sa
mp
les
)
Time (frame #)
Reframe
(e.g. Buffer)
To frequency
(e.g. FFT)
Wavelet scalogram Constant Q transformBasic spectrogram Perceptually-spaced (e.g.
Mel, Bark) Spectrogram
Easiest to
understand and
implement
More compact for
speech & audio
applications
Best resolution, for
non-periodic
signals
Better resolution at
low frequencies
...
![Page 25: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/25.jpg)
25
Extracting Features from Signals: Application-Agnostic Examples
BW measurements Spectral statistics Harmonic analysis Octave spectrum
Frequency domain
Time domain
![Page 26: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/26.jpg)
26
Domain-Specific Features and Transformations – Examples
Speech and AudioNavigation and Sensor Fusion
▪ Orientation
▪ Height
▪ Position
▪ Multi-object tracking
▪ …
▪ Acceleration, angular velocity
▪ Magnetic field
▪ GPS readingfrom
▪ Micro-Doppler analysis
▪ Range-Doppler processing
▪ Synthetic aperture imaging
▪ Spectral analysis
▪ Waveform ambiguity
▪ ...
Radar
▪ Train Word Embeddings
▪ Word2Vec
▪ Topic Modeling
▪ ...
Text Analytics
▪ MFCC
▪ GTCC
▪ MDCT
▪ Pitch, harmonicity
▪ Spectral shape
descriptors
▪ ...
![Page 27: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/27.jpg)
27
Automated Feature Extraction: Wavelet Scattering
▪ Can relieve requirements on amount of data and model complexity
– Featured in leader-boards a number of research competitions
▪ Framework for extracting features [1]
Wa
ve
let
Co
nvo
luti
on
No
nli
ne
ari
ty
Ave
rag
ing
Wa
ve
let
Co
nvo
luti
on
No
nli
ne
ari
ty
Ave
rag
ing
Wa
ve
let
Co
nvo
luti
on
No
nli
ne
ari
ty
Ave
rag
ing
Fixed Fixed Fixed
[1] Joan Bruna, and Stephane Mallat, P. 2013. Invariant Scattering Convolution Networks. IEEE Transactions on Pattern Analysis
and Machine Intelligence, Vol. 35, No. 8, pp. 1872-1886.
Cla
ss
ifie
r
Deep Feature Extraction
![Page 28: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/28.jpg)
28
Agenda
▪ Deep Learning – Basic ideas
▪ Deep Learning Model Development for Signals, Time Series, and Text
– Data
– Processing and transformation
– Model design and optimization
– Acceleration, prototyping, and deployment
▪ Conclusions
![Page 29: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/29.jpg)
29
Developing Deep Learning Models
Design
Train
Optimize
Design Network
Pre-trained Networks
Accelerate Training
Bayesian
Hyperparameter
Optimization
MATLAB as a
container on NGC
Model Exchange
![Page 30: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/30.jpg)
30
Exchange Models With Deep Learning Frameworks
ONNX
PyTorch
MATLABMXNet
TensorFlow
ChainerCore ML
ONNX = Open Neural Network Exchange Format
TensorFlow-
Keras
Caffe
![Page 31: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/31.jpg)
31
Exchange Models With Deep Learning Frameworks
ONNX
PyTorch
MATLABMXNet
TensorFlow
ChainerCore ML
ONNX = Open Neural Network Exchange Format
TensorFlow-
Keras
Caffe
Keras
importer
Caffe
importer
Deployment
Augmentation
and
Optimization
Visualization
and
Debugging
![Page 32: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/32.jpg)
32
Agenda
▪ Deep Learning – Basic ideas
▪ Deep Learning Model Development for Signals, Time Series, and Text
– Data
– Processing and transformation
– Model design and optimization
– Acceleration, prototyping, and deployment
▪ Conclusions
![Page 33: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/33.jpg)
33
Deployment and Scaling for A.I.
Embedded Devices Enterprise Systems
MATLAB
![Page 34: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/34.jpg)
34
Deploying Deep Learning Models for Inference
Code
Generation
NVIDIA
TensorRT &
cuDNN
Libraries
ARM
Compute
Library
Intel
MKL-DNN
Library
Application
logic
Auto-generated
Code
(C/C++/CUDA)
![Page 35: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/35.jpg)
35
With GPU Coder, MATLAB is fast
Intel® Xeon® CPU 3.6 GHz - NVIDIA libraries: CUDA10 - cuDNN 7 - Frameworks: TensorFlow 1.13.0, MXNet 1.4.0 PyTorch 1.0.0
GPU Coder is faster
than TensorFlow,
MXNet and Pytorch
TensorFlow
MXNet
GPU Coder
PyTorch
![Page 36: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/36.jpg)
36
Enterprise Deployment
Deployment to the cloud with MATLAB Compiler and MATLAB Production Server
![Page 37: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/37.jpg)
37
Agenda
▪ Deep Learning – Basic ideas
▪ Deep Learning Model Development for Signals, Time Series, and Text
– Data
– Processing and transformation
– Model design and optimization
– Acceleration, prototyping, and deployment
▪ Conclusions
![Page 38: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/38.jpg)
38
Deep Learning Workflow
Data Labeling
Deep learning models only
as good as
training data
Limited data
availability
Domain-specific data
processing desirable
Limited reference
researchApplication-specific algorithms and tools
Deployment and
Scaling to various
platforms
Data-labeling Apps
and Examples
Augmentation and
simulation algorithms
Collaboration
in the AI
ecosystem
Challenges – Signals and Time Series
![Page 39: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/39.jpg)
39
Domain-Specific Features and Transformations – Examples
Audio
Speech Command Recognition
Voice Activity Detection in Noise
Denoise Speech
Classify Gender
Signal
Music Genre Classification
Human Activity Recognition
ECG Signal Classification
Waveform Segmentation
Time-Series and Text
Classify Time Series Using Wavelet Analysis
Sequence-to-Sequence Classification
Classify Text Data Using LSTMs
Classify Text Data Using CNNs
Comms and Radar
Radar Waveform Classification
Modulation Classification
![Page 40: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/40.jpg)
40
Call to Action - to be edited by the local team
- Visit the booth
- Attend the talk on Deep Learning and Reinforcement Learning
Workflows in A.I.
![Page 41: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/41.jpg)
41
Back up
![Page 42: AI Techniques in MATLAB for Signal, Time-Series, and Text Data€¦ · AI and Deep Learning for Signals in the News Deep Learning developed and evolved for image processing and computer](https://reader034.vdocuments.net/reader034/viewer/2022050215/5f617b9449f8ba3c1016e90b/html5/thumbnails/42.jpg)
42
Summary - Deep learning workflow in MATLAB
Standalone
DeploymentDeep Neural Network
Design + TrainingApplication
design
NVIDIA TensorRT
cuDNN Libraries
Intel
MKL-DNN
LibraryApplication
logic
Coders
ARM Compute
Library
Deep Learning with MATLAB
Model
Exhange
Trained DNN
Transfer
learning
- Inception-v3
- AlexNet
- SqueezeNet
- ResNet-101
- GoogLeNet
-…