 lchu
|
1cc9df19e6
remove unused import
|
vor 1 Jahr |
|
lchu
|
0c51b47262
fix #90
|
vor 1 Jahr |
|
lchu
|
c19c5c69aa
fix fsdp construction on low_cpu_fsdp
|
vor 1 Jahr |
|
lchu
|
895dfcea30
add nightly check for using low_cpu_fsdp mode
|
vor 1 Jahr |
|
lchu
|
1e64fc98d9
switch to simpler param_init_fn and meta device init
|
vor 1 Jahr |
|
lchu
|
101391f46a
Revert "replace init_empty_weights with torch.device(meta)"
|
vor 1 Jahr |
|
lchu
|
c8d4f38d23
replace init_empty_weights with torch.device(meta)
|
vor 1 Jahr |
|
lchu
|
d8a81bb531
save cpu mem by leveraging FSDP rank0 broadcasting
|
vor 1 Jahr |
 Andrew Gu
|
71fdc4920a
Save memory and fix typos
|
vor 1 Jahr |
 Hamid Shojanazeri
|
7ec390bfc8
aliging special tokens in toeknizer with HF latest
|
vor 1 Jahr |
 Rohan Varma
|
d3d7a1656e
Update llama_finetuning.py
|
vor 1 Jahr |
 chauhang
|
4767f09ecd
Initial commit
|
vor 1 Jahr |
