# groupnorm

Normalize data across grouped subsets of channels for each observation independently

*Since R2020b*

## Syntax

## Description

The group normalization operation normalizes the input data
across grouped subsets of channels for each observation independently. To speed up training of
the convolutional neural network and reduce the sensitivity to network initialization, use group
normalization between convolution and nonlinear operations such as `relu`

.

After normalization, the operation shifts the input by a learnable offset *β* and scales it by a learnable scale factor *γ*.

The `groupnorm`

function applies the group normalization operation to
`dlarray`

data.
Using `dlarray`

objects makes working with high
dimensional data easier by allowing you to label the dimensions. For example, you can label
which dimensions correspond to spatial, time, channel, and batch dimensions using the
`"S"`

, `"T"`

, `"C"`

, and
`"B"`

labels, respectively. For unspecified and other dimensions, use the
`"U"`

label. For `dlarray`

object functions that operate
over particular dimensions, you can specify the dimension labels by formatting the
`dlarray`

object directly, or by using the `DataFormat`

option.

**Note**

To apply group normalization within a `dlnetwork`

object, use `groupNormalizationLayer`

.

applies the group normalization operation to the input data `Y`

= groupnorm(`X`

,`numGroups`

,`offset`

,`scaleFactor`

)`X`

using the
specified number of groups and transforms it using the specified offset and scale
factor.

The function normalizes over grouped subsets of the `'C'`

(channel)
dimension and the `'S'`

(spatial), `'T'`

(time), and
`'U'`

(unspecified) dimensions of `X`

for each
observation in the `'B'`

(batch) dimension, independently.

For unformatted input data, use the `'DataFormat'`

option.

applies the group normalization operation to the unformatted `Y`

= groupnorm(`X`

,`numGroups`

,`offset`

,`scaleFactor`

,'DataFormat',FMT)`dlarray`

object
`X`

with format specified by `FMT`

. The output
`Y`

is an unformatted `dlarray`

object with dimensions
in the same order as `X`

. For example,
`'DataFormat','SSCB'`

specifies data for 2-D image input with format
`'SSCB'`

(spatial, spatial, channel, batch).

specifies options using one or more name-value arguments in addition to the input arguments
in previous syntaxes. For example, `Y`

= groupnorm(___`Name,Value`

)`'Epsilon',3e-5`

sets the variance
offset to `3e-5`

.

## Examples

## Input Arguments

## Output Arguments

## Algorithms

## References

[1] Wu, Yuxin, and Kaiming He. “Group Normalization.” Preprint submitted June 11, 2018. https://arxiv.org/abs/1803.08494.

## Extended Capabilities

## Version History

**Introduced in R2020b**