learning/annotated_deep_learning_paper_implementations
1
0
Fork 0
mirror of https://github.com/labmlai/annotated_deep_learning_paper_implementations.git synced 2025-10-31 18:58:43 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
annotated_deep_learning_pap…/labml_nn/transformers
History
Varuna Jayasiri abe5caba6f 📚 glu variants
2021-01-26 16:54:23 +05:30
..
feedback
✨ ffn glu variants configs & 🐛 gated ffn
2021-01-25 09:44:38 +05:30
glu_variants
📚 glu variants
2021-01-26 16:54:23 +05:30
gpt
✨ ffn glu variants configs & 🐛 gated ffn
2021-01-25 09:44:38 +05:30
knn
✨ ffn glu variants configs & 🐛 gated ffn
2021-01-25 09:44:38 +05:30
switch
✨ ffn glu variants configs & 🐛 gated ffn
2021-01-25 09:44:38 +05:30
__init__.py
link switch transformer
2021-01-21 09:52:30 +05:30
configs.py
📚 glu variants
2021-01-26 16:54:23 +05:30
feed_forward.py
📚 glu variants
2021-01-26 16:54:23 +05:30
label_smoothing_loss.py
yaml configs
2020-12-10 10:05:06 +05:30
mha.py
transpose with \top
2021-01-10 12:16:50 +05:30
models.py
✨ ffn glu variants configs & 🐛 gated ffn
2021-01-25 09:44:38 +05:30
positional_encoding.py
no loss smoothing
2021-01-07 12:02:19 +05:30
relative_mha.py
transpose with \top
2021-01-10 12:16:50 +05:30
utils.py
yaml configs
2020-12-10 10:05:06 +05:30