8 Commits

Author SHA1 Message Date
24bd64af7c check loaded weights 2024-08-21 09:54:53 +05:30
b260349c68 LoRA GPT2 n_heads fix and notes 2024-08-18 16:34:13 +05:30
012fc7f0f0 LoRA GPT2 n_heads fix and notes 2024-08-18 16:25:21 +05:30
ce21dcf76c LoRA experiment 2024-08-18 14:26:33 +05:30
3349afdcf5 simplify loop def in training 2024-08-18 01:06:06 +05:30
863772e04a rename layers 2024-08-18 01:04:04 +05:30
d69f1c1058 LoRA experiment notes 2024-08-16 16:14:52 +05:30
61d32f4696 create LoRA experiment
- remove global configs
- Do weight loading inside experiment
- remove train and transform notebooks
2024-08-07 09:49:35 +05:30