From 15d82d841de853b77329fbba2bae406781daa675 Mon Sep 17 00:00:00 2001 From: Varuna Jayasiri Date: Wed, 28 Apr 2021 10:49:07 +0530 Subject: [PATCH] WS readme --- .../weight_standardization/readme.html | 118 ++++++++++++++++++ .../weight_standardization/readme.md | 6 + 2 files changed, 124 insertions(+) create mode 100644 docs/normalization/weight_standardization/readme.html create mode 100644 labml_nn/normalization/weight_standardization/readme.md diff --git a/docs/normalization/weight_standardization/readme.html b/docs/normalization/weight_standardization/readme.html new file mode 100644 index 00000000..c0466887 --- /dev/null +++ b/docs/normalization/weight_standardization/readme.html @@ -0,0 +1,118 @@ + + + + + + + + + + + + + + + + + + + + + + + Weight Standardization + + + + + + + + +
+
+
+
+

+ home + normalization + weight_standardization +

+

+ + + Github + + Join Slact + + Twitter +

+
+
+
+
+
+ # +
+

Weight Standardization

+

This is a PyTorch implementation of Weight Standardization from the paper + Micro-Batch Training with Batch-Channel Normalization and Weight Standardization. +We also have an +annotated implementation of Batch-Channel Normalization.

+
+
+ +
+
+
+ + + + + + \ No newline at end of file diff --git a/labml_nn/normalization/weight_standardization/readme.md b/labml_nn/normalization/weight_standardization/readme.md new file mode 100644 index 00000000..5b8fe70a --- /dev/null +++ b/labml_nn/normalization/weight_standardization/readme.md @@ -0,0 +1,6 @@ +# [Weight Standardization](https://nn.labml.ai/normalization/weight_standardization/index.html) + +This is a [PyTorch](https://pytorch.org) implementation of Weight Standardization from the paper + [Micro-Batch Training with Batch-Channel Normalization and Weight Standardization](https://arxiv.org/abs/1903.10520). +We also have an +[annotated implementation of Batch-Channel Normalization](https://nn.labml.ai/normalization/batch_channel_normalization/index.html).