Custom Training Loops

Train deep learning networks using custom training loops

If the trainingOptions function does not provide the training options that you need for your task, or custom output layers do not support the loss functions that you need, then you can define a custom training loop. For networks that cannot be created using layer graphs, you can define custom networks as a function. To learn more, see Define Custom Training Loops, Loss Functions, and Networks.

Functions

expand all

Custom Training Loops

`dlnetwork`	Deep learning network for custom training loops
`trainingProgressMonitor`	Monitor and plot training progress for deep learning custom training loops
`minibatchqueue`	Create mini-batches for deep learning
`padsequences`	Pad or truncate sequence data to same length
`dlarray`	Deep learning array for customization
`dlgradient`	Compute gradients for custom training loops using automatic differentiation
`dlfeval`	Evaluate deep learning model for custom training loops

Loss Operations

`crossentropy`	Cross-entropy loss for classification tasks
`l1loss`	L₁ loss for regression tasks
`l2loss`	L₂ loss for regression tasks
`huber`	Huber loss for regression tasks
`mse`	Half mean squared error
`ctc`	Connectionist temporal classification (CTC) loss for unaligned sequence classification

Topics

Train Network Using Custom Training Loop
This example shows how to train a network that classifies handwritten digits with a custom learning rate schedule.
Train Sequence Classification Network Using Custom Training Loop
This example shows how to train a network that classifies sequences with a custom learning rate schedule.
Define Custom Training Loops, Loss Functions, and Networks
Learn how to define and customize deep learning training loops, loss functions, and networks using automatic differentiation.
Specify Training Options in Custom Training Loop
Learn how to specify common training options in a custom training loop.
Monitor Custom Training Loop Progress
Track and plot custom training loop progress.
Detect Issues During Deep Neural Network Training
This example shows how to automatically detect issues while training a deep neural network.