RepoCerebrasCerebraspublished Apr 4, 2019seen 5d

Cerebras/online-normalization

Python

Open original ↗

Captured source

source ↗
published Apr 4, 2019seen 5dcaptured 8hhttp 200method plain

Cerebras/online-normalization

Description: Online Normalization for Training Neural Networks (Companion Repository)

Language: Python

License: BSD-3-Clause

Stars: 89

Forks: 21

Open issues: 2

Created: 2019-04-04T04:45:25Z

Pushed: 2021-04-22T01:06:40Z

Default branch: master

Fork: no

Archived: no

README:

Online Normalization

Implementation of Online Normalization for Training Neural Networks. Different implementations of Online Normalization can be found in the online_norm folder. Code to reproduce experimental results can be found in the experimentation folder. The examples folder has minimally modified versions of commonly trained networks, modified to replace Batch Normalization with Online Normalization.

PyTorch Usage

Installation

cd ./online-norm/pytorch
python -m pip install -e .

Usage

see ./online-norm/pytorch

TensorFlow Usage

Installation

cd ./online-norm/tensorflow
python -m pip install -e .

Usage

see ./online-norm/tensorflow

Contact

The reference code in this repository is written and maintained by the authors of the research publication Online Normalization for Training Neural Networks.