Awesome
Online Normalization
Implementation of
Online Normalization for Training Neural Networks.
Different implementations of Online Normalization can be found in the
online_norm
folder. Code to reproduce experimental results can be found in
the experimentation
folder. The examples
folder has minimally modified
versions of commonly trained networks, modified to replace Batch Normalization
with Online Normalization.
PyTorch Usage
Installation
cd ./online-norm/pytorch
python -m pip install -e .
Usage
see ./online-norm/pytorch
TensorFlow Usage
Installation
cd ./online-norm/tensorflow
python -m pip install -e .
Usage
see ./online-norm/tensorflow
Contact
The reference code in this repository is written and maintained by the authors of the research publication Online Normalization for Training Neural Networks.