 Matthias Reso
|
ab254d121c
7b -> 8b
|
il y a 10 mois |
|
Matthias Reso
|
43cb6a2db4
Remove check for nighlies for low_cpu_fsdp and bump torch version to 2.2 instead
|
il y a 10 mois |
|
Matthias Reso
|
cad284c66f
Replace new model url
|
il y a 10 mois |
|
Matthias Reso
|
8b0a233c1a
Use new chat format in custom dataset
|
il y a 10 mois |
|
Matthias Reso
|
83fae41195
Add test for chat completion formatting
|
il y a 10 mois |
|
Matthias Reso
|
6d9d48d619
Use apply_chat_template instead of custom functions
|
il y a 10 mois |
|
Matthias Reso
|
5efea160a2
Adapt test_finetuning to new model
|
il y a 10 mois |
|
Matthias Reso
|
739483f262
Adjust test_grammar_datasets to stable sort
|
il y a 10 mois |
|
Matthias Reso
|
b96e435cda
Adjust test_samsum_dataset to second model
|
il y a 10 mois |
|
Matthias Reso
|
fac41298b0
Adapt test_custom_dataset to new model
|
il y a 10 mois |
|
Matthias Reso
|
960014a3bb
Fix test_custom_dataset by introducing a stable sort algorithm
|
il y a 10 mois |
|
Matthias Reso
|
b5583b31d5
Adapt test_grammar_dataset to new model
|
il y a 10 mois |
|
Matthias Reso
|
17a6d16289
Test batching for both llama versions
|
il y a 10 mois |
|
Matthias Reso
|
a414ca6a57
Update chat format for llama3
|
il y a 10 mois |
|
Matthias Reso
|
113ea18bf1
Replace LlamaTokenizer with AutoTokenizer
|
il y a 10 mois |
 Hamid Shojanazeri
|
aaa9e2c863
Adding a feature that will stop the training/eval process after reaching some max_steps (#428)
|
il y a 10 mois |
 Kai Wu
|
e6f69f84ad
add max_steps_reached to reduce redundancy
|
il y a 10 mois |
|
Kai Wu
|
362cda0fa6
fixing test_gradient_accumulation and test_save_to_json
|
il y a 10 mois |
|
Kai Wu
|
fa0a389f74
add max_step feature for training and eval
|
il y a 10 mois |
|
Hamid Shojanazeri
|
37c8f72211
Update location and name of llm.py example notebook (#417)
|
il y a 11 mois |
 Thomas Robinson
|
79266217ef
Update location and name of llm.py example notebook
|
il y a 11 mois |
|
Hamid Shojanazeri
|
f7aa02af9f
only save training params on rank 0 (#415)
|
il y a 11 mois |
 jpgard
|
6954b16b3b
only save training params on rank 0
|
il y a 11 mois |
|
Hamid Shojanazeri
|
64e189914f
update due to peft new release (#407)
|
il y a 11 mois |
|
Hamid Shojanazeri
|
11f51db28c
adding the kbit prep in the code
|
il y a 11 mois |
|
Hamid Shojanazeri
|
f058ff6ccd
update due to peft new release
|
il y a 11 mois |
|
Hamid Shojanazeri
|
6a7478a6aa
Reorg inference throughput folder structure (#404)
|
il y a 11 mois |
 Chester Hu
|
367e4869ac
Reorg inference throughput folder structure
|
il y a 11 mois |
|
Hamid Shojanazeri
|
d6eb83f6c5
Add llm class so that externally-hosted models can be called (#398)
|
il y a 11 mois |
|
Thomas Robinson
|
0346d0d5b8
Add documentation and examples
|
il y a 11 mois |
