 Beto
|
7e7c8d2514
fixing typo on x label
|
hai 1 ano |
|
Beto
|
5a011246e1
Modularizing the graphs further. Plotting train and validation separetly due to difference in number of steps.
|
hai 1 ano |
|
Beto
|
9938afd088
condensed functionality in a single function for plotting both epoch and step metrics
|
hai 1 ano |
|
Beto
|
92be45b0fe
Adding matplotlib to requirements. Removing import from train_utils
|
hai 1 ano |
|
Beto
|
80a6ac41b5
Adding the rank to the metrics filename to differentiate the run from each GPU
|
hai 1 ano |
|
Beto
|
2f7256918e
Adding support to save fine tuning metrics to json. Adding script to plot saved metrics.
|
hai 1 ano |
 Matthias Reso
|
8ac44ef3be
Fix vocab size mismatch in inference due to added pad token
|
hai 1 ano |
 Geeta Chauhan
|
40b32ba559
Fix tqdm bar not change length after terminal is resized (#201)
|
hai 1 ano |
 hongbo.mo
|
6217635e87
Fix tqdm bar not change length after terminal is resized
|
hai 1 ano |
|
Matthias Reso
|
0b2fa40dba
Add unit test for weight decay
|
hai 1 ano |
 Shijie Wu
|
91e2573aa8
pass weight_decay into optimizer
|
hai 1 ano |
 Hamid Shojanazeri
|
c38bf5bdd3
Add FSDP CPU offloading option (#122)
|
hai 1 ano |
 Howard Liberty
|
cc356b6017
Add FSDP CPU offloading option
|
hai 1 ano |
 Yuanhao
|
e554c1c8bf
The tokenizer will not add eos_token by default
|
hai 1 ano |
 tim-a-davis
|
3038020aa4
Replaced ClassVar config param with field
|
hai 1 ano |
|
Hamid Shojanazeri
|
cfacee4302
Update LLM_finetuning.md
|
hai 1 ano |
|
Hamid Shojanazeri
|
62dd2b3f4b
Update docs/LLM_finetuning.md
|
hai 1 ano |
 varunfb
|
6f2201c655
Updated spell checker to resolve the issues in LLM_finetuning.md
|
hai 1 ano |
|
varunfb
|
2c1ecba170
Update LLM_finetuning.md
|
hai 1 ano |
|
Geeta Chauhan
|
279f4d4a0b
Use OpenAssistent/oasst1 dataset for custom dataset example (#180)
|
hai 1 ano |
 Kautilya Kondragunta
|
b4c71bebee
Update chat_completion.py
|
hai 1 ano |
|
Matthias Reso
|
eccf7cb3dc
Check additional example in resulting dataset
|
hai 1 ano |
|
Matthias Reso
|
c33ea3cacb
Fix pbar update
|
hai 1 ano |
|
hongbo.mo
|
5e910e6a42
Fix typo
|
hai 1 ano |
|
hongbo.mo
|
771da57167
Fix Dataset.md link to ../examples/custom_dataset.py
|
hai 1 ano |
|
hongbo.mo
|
0bc6a07a80
bugfix: update tqdm bar with the fixed gradient_accumulation_steps
|
hai 1 ano |
|
Matthias Reso
|
ec00a2f722
Fix batching error
|
hai 1 ano |
|
Matthias Reso
|
631046e883
Fix spell check
|
hai 1 ano |
|
Matthias Reso
|
72d7d9dcb8
Fix link
|
hai 1 ano |
|
Matthias Reso
|
1cfd709e26
Fix typos
|
hai 1 ano |
