learning/annotated_deep_learning_paper_implementations
1
0
Fork 0
mirror of https://github.com/labmlai/annotated_deep_learning_paper_implementations.git synced 2025-08-26 08:41:23 +08:00
Code Issues Packages Projects Releases Wiki Activity

labml app links

Browse Source
This commit is contained in:
Varuna Jayasiri
2021-02-27 17:54:11 +05:30
parent 0db4eeda19
commit c2107755bb
7 changed files with 8 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
labml_nn/optimizers/amsgrad.py
View File

@ -195,10 +195,10 @@ def _synthetic_experiment(is_adam: bool):
if __name__ == '__main__':
# Run the synthetic experiment is *Adam*.
# [Here are the results](https://web.lab-ml.com/metrics?uuid=61ebfdaa384411eb94d8acde48001122).
# [Here are the results](https://app.labml.ai/run/61ebfdaa384411eb94d8acde48001122).
# You can see that Adam converges at $x = +1$
_synthetic_experiment(True)
# Run the synthetic experiment is *AMSGrad*
# [Here are the results](https://web.lab-ml.com/metrics?uuid=bc06405c384411eb8b82acde48001122).
# [Here are the results](https://app.labml.ai/run/uuid=bc06405c384411eb8b82acde48001122).
# You can see that AMSGrad converges to true optimal $x = -1$
_synthetic_experiment(False)