딥러닝 사용자 지정 훈련 루프

딥러닝 훈련 루프 및 손실 함수 사용자 지정

trainingOptions 함수가 작업에 필요한 훈련 옵션을 제공하지 않거나 사용자 지정한 출력 계층이 필요한 손실 함수를 지원하지 않을 경우에는 사용자 지정 훈련 루프를 정의할 수 있습니다. 계층 그래프를 사용하여 만들 수 없는 신경망의 경우 사용자 지정 신경망을 함수로 정의할 수 있습니다. 자세한 내용은 사용자 지정 훈련 루프, 손실 함수 및 신경망 정의 항목을 참조하십시오.

함수

모두 확장

사용자 지정 훈련 루프

`dlnetwork`	Deep learning network for custom training loops
`forward`	Compute deep learning network output for training
`predict`	Compute deep learning network output for inference
`adamupdate`	Update parameters using adaptive moment estimation (Adam)
`rmspropupdate`	Update parameters using root mean squared propagation (RMSProp)
`sgdmupdate`	Update parameters using stochastic gradient descent with momentum (SGDM)
`dlupdate`	Update parameters using custom function
`minibatchqueue`	Create mini-batches for deep learning
`onehotencode`	Encode data labels into one-hot vectors
`onehotdecode`	Decode probability vectors into class labels
`padsequences`	Pad or truncate sequence data to same length
`initialize`	Initialize learnable and state parameters of a `dlnetwork`

자동 미분

`dlarray`	Deep learning array for custom training loops
`dlgradient`	Compute gradients for custom training loops using automatic differentiation
`dlfeval`	Evaluate deep learning model for custom training loops
`dims`	`dlarray`의 차원 레이블
`finddim`	Find dimensions with specified label
`stripdims`	Remove `dlarray` data format
`extractdata`	Extract data from `dlarray`
`isdlarray`	Determine whether input is `dlarray`
`functionToLayerGraph`	Convert deep learning model function to a layer graph

딥러닝 연산

`dlconv`	Deep learning convolution
`dltranspconv`	Deep learning transposed convolution
`lstm`	Long short-term memory
`gru`	Gated recurrent unit
`embed`	Embed discrete data
`fullyconnect`	Sum all weighted input data and apply a bias
`relu`	Apply rectified linear unit activation
`leakyrelu`	Apply leaky rectified linear unit activation
`batchnorm`	Normalize data across all observations for each channel independently
`crosschannelnorm`	Cross channel square-normalize using local responses
`groupnorm`	Normalize data across grouped subsets of channels for each observation independently
`instancenorm`	Normalize across each channel for each observation independently
`layernorm`	Normalize data across all channels for each observation independently
`avgpool`	Pool data to average values over spatial dimensions
`maxpool`	Pool data to maximum value
`maxunpool`	Unpool the output of a maximum pooling operation
`softmax`	Apply softmax activation to channel dimension
`sigmoid`	시그모이드 활성화 적용
`crossentropy`	Cross-entropy loss for classification tasks
`huber`	Huber loss for regression tasks
`mse`	Half mean squared error
`ctc`	Connectionist temporal classification (CTC) loss for unaligned sequence classification

딥러닝 함수 가속

`dlaccelerate`	Accelerate deep learning function for custom training loops
`AcceleratedFunction`	Accelerated deep learning function
`clearCache`	Clear accelerated deep learning function trace cache

도움말 항목

사용자 지정 훈련 루프

Train Deep Learning Model in MATLAB

Learn how to training deep learning models in MATLAB^®.

사용자 지정 훈련 루프, 손실 함수 및 신경망 정의

자동 미분을 사용하여 사용자 지정 딥러닝 훈련 루프, 손실 함수 및 신경망을 정의하는 방법을 알아봅니다.

Train Network Using Custom Training Loop

This example shows how to train a network that classifies handwritten digits with a custom learning rate schedule.

Specify Training Options in Custom Training Loop

Learn how to specify common training options in a custom training loop.

Define Model Gradients Function for Custom Training Loop

Learn how to define a model gradients function for a custom training loop.

Update Batch Normalization Statistics in Custom Training Loop

This example shows how to update the network state in a custom training loop.

Make Predictions Using dlnetwork Object

This example shows how to make predictions using a dlnetwork object by splitting data into mini-batches.

Train Network on Image and Feature Data

This example shows how to train a network that classifies handwritten digits using both image and feature input data.

Train Network with Multiple Outputs

This example shows how to train a deep learning network with multiple outputs that predict both labels and angles of rotations of handwritten digits.

Classify Videos Using Deep Learning with Custom Training Loop

This example shows how to create a network for video classification by combining a pretrained image classification model and a sequence classification network.

Train Image Classification Network Robust to Adversarial Examples

This example shows how to train a neural network that is robust to adversarial examples using fast gradient sign method (FGSM) adversarial training.

Train Robust Deep Learning Network with Jacobian Regularization

This example shows how to train a neural network that is robust to adversarial examples using a Jacobian regularization scheme [1].