 Hamid Shojanazeri
|
a955ed1999
added checks for dist barrier and commented cuda exapnadable segements and dist_dbug
|
il y a 1 an |
|
Hamid Shojanazeri
|
a2403c7c1a
clean up
|
il y a 1 an |
|
Hamid Shojanazeri
|
e9559d2669
fixing the train/eval_loss calcualtion
|
il y a 1 an |
|
Hamid Shojanazeri
|
4ba4400a75
adding dist barrier before and after checkpointing
|
il y a 1 an |
|
Hamid Shojanazeri
|
a49a2c2804
adding PT cuda allocation expand flag
|
il y a 1 an |
|
Hamid Shojanazeri
|
442c1ccf7c
adding barrier to end of trainer loop
|
il y a 1 an |
|
Hamid Shojanazeri
|
f74d57dc08
printing scores based on fsdp usage or single gpu
|
il y a 1 an |
|
Hamid Shojanazeri
|
3d887ea483
update with active memory and removing rank0 for eval score
|
il y a 1 an |
|
Hamid Shojanazeri
|
bedb96b78a
fixing the full state path in checkpoint handler
|
il y a 1 an |
 Geeta Chauhan
|
74bde65a62
Adding Supporting Files For link and Spell Check (#26)
|
il y a 1 an |
|
Hamid Shojanazeri
|
83fde7b94b
Fix cuda id for using quantization (#40)
|
il y a 1 an |
|
Hamid Shojanazeri
|
bd01f64cbd
Merge branch 'main' into fix-cuda_id
|
il y a 1 an |
|
Geeta Chauhan
|
e5970e2e1f
Improve FSDP LoRA Memory Usage (#41)
|
il y a 1 an |
 Andrew Gu
|
71fdc4920a
Save memory and fix typos
|
il y a 1 an |
|
Hamid Shojanazeri
|
a7156dfb5d
fixing the cuda id
|
il y a 1 an |
|
Hamid Shojanazeri
|
707af7ea24
adding cuda:0 for non-fsdp situations
|
il y a 1 an |
 sekyonda
|
f93d4c891e
Updates per Geeta's request
|
il y a 1 an |
|
sekyondaMeta
|
226a10df75
Merge branch 'facebookresearch:main' into spellCheck
|
il y a 1 an |
|
Geeta Chauhan
|
1e0f8a1fb7
fixing scaler for both fsdp and non fsdp (#34)
|
il y a 1 an |
|
Hamid Shojanazeri
|
6678be75ad
fixing identation
|
il y a 1 an |
|
Hamid Shojanazeri
|
6a84e9e4d5
fixing scaler for both fsdp and non fsdp
|
il y a 1 an |
|
Geeta Chauhan
|
1838378e0a
fixing the condition for moving to cuda (#33)
|
il y a 1 an |
|
Hamid Shojanazeri
|
065ddaa77b
fixing the condition for moving to cuda
|
il y a 1 an |
|
Geeta Chauhan
|
0493768dc1
fix typos and spelling errors (#20)
|
il y a 1 an |
|
Geeta Chauhan
|
c8cd2f40b1
modify to steping the lr scheduler each epoch (#28)
|
il y a 1 an |
|
Hamid Shojanazeri
|
20b061e01c
modify to steping the lr scheduler each epoch
|
il y a 1 an |
|
sekyonda
|
1da98b14f0
Update README.md
|
il y a 1 an |
|
sekyonda
|
07991603ff
Update inference.md
|
il y a 1 an |
|
sekyonda
|
eb2ed73bb3
Update README.md
|
il y a 1 an |
|
sekyonda
|
7af5cc4292
Adding Supporting Files For link and Spell Check
|
il y a 1 an |
