 Matthias Reso
|
113ea18bf1
Replace LlamaTokenizer with AutoTokenizer
|
vor 11 Monaten |
 Hamid Shojanazeri
|
11f51db28c
adding the kbit prep in the code
|
vor 11 Monaten |
|
Hamid Shojanazeri
|
f058ff6ccd
update due to peft new release
|
vor 11 Monaten |
|
Hamid Shojanazeri
|
ffdc93f00a
Merge branch 'main' into wandb_logging
|
vor 1 Jahr |
|
Matthias Reso
|
c5a382e509
Make tests run on cpu only machines
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
43ea6bfa71
Merge branch 'main' into ssdp
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
d51d2cce9c
adding sdpa for flash attn
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
9a2434f408
update the fine-tuning script
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
162be4c045
Revert "Flop counter, profiling and GC (#357)"
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
71d137c722
Merge branch 'main' into flop_counter_gc
|
vor 1 Jahr |
 Less Wright
|
3f2c33e4f8
Update finetuning.py - remove nightly check
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
b15ffeeaf4
clean up
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
19089269d3
add gc
|
vor 1 Jahr |
 kldarek
|
989b6ee812
wandb logging feedback
|
vor 1 Jahr |
 Abhilash Majumder
|
4793f0fdf3
Merge branch 'main' into ipex_feature
|
vor 1 Jahr |
|
kldarek
|
fc5485d916
fixing wandb for fsdp
|
vor 1 Jahr |
|
kldarek
|
f2406cac07
cleanup spaces
|
vor 1 Jahr |
|
kldarek
|
cf373529f7
basic wandb logging instrumentation
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
aa24e8f57e
fix typos
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
38c8cf08c4
adding hsdp
|
vor 1 Jahr |
|
Abhilash Majumder
|
6a78b96764
Merge branch 'main' into ipex_feature
|
vor 1 Jahr |
|
Matthias Reso
|
4c225c65eb
Fix order of concat vs sampler
|
vor 1 Jahr |
|
Matthias Reso
|
5da84b2913
Fix usage of dataclass for train_config and fsdp_config
|
vor 1 Jahr |
|
Matthias Reso
|
653a79e3dd
Invalidate context in labels for samsum + grammar
|
vor 1 Jahr |
|
Matthias Reso
|
a647955fc8
Make packing/padding a training setting
|
vor 1 Jahr |
|
Matthias Reso
|
2e4bd2a665
Resize vocab size to fix idx error
|
vor 1 Jahr |
|
Matthias Reso
|
ca41c1c697
Adjust tests to len based batch sampling
|
vor 1 Jahr |
 Shijie Wu
|
91e2573aa8
pass weight_decay into optimizer
|
vor 1 Jahr |
 Howard Liberty
|
cc356b6017
Add FSDP CPU offloading option
|
vor 1 Jahr |
 abhilash1910
|
ad6b27d316
merge conflicts
|
vor 1 Jahr |
