 Matthias Reso
|
5bceb44542
Fix fsdp_config.pure_bf16 flag in README
|
il y a 1 an |
|
Matthias Reso
|
53fd82355f
Add missing changes
|
il y a 1 an |
|
Matthias Reso
|
07bcffbf50
clean up unit tests + add batching test
|
il y a 1 an |
|
Matthias Reso
|
4c225c65eb
Fix order of concat vs sampler
|
il y a 1 an |
|
Matthias Reso
|
f9756ca79d
Added packing test for samsum
|
il y a 1 an |
|
Matthias Reso
|
5a359b7bf2
Fix sampler vs batch_sampler
|
il y a 1 an |
|
Matthias Reso
|
fe8122daf1
Adapt alpaca dataset to ConcatDataset
|
il y a 1 an |
|
Matthias Reso
|
5da84b2913
Fix usage of dataclass for train_config and fsdp_config
|
il y a 1 an |
|
Matthias Reso
|
aa5dee241a
Fix unit test to reflect batch packing
|
il y a 1 an |
|
Matthias Reso
|
8620ab8ac2
Fix invalid labels for context in custom dataset/oasst1
|
il y a 1 an |
 Hamid Shojanazeri
|
ef810bbee0
addig flop counter
|
il y a 1 an |
|
Matthias Reso
|
52c417b7d5
Merge branch 'fix/invalidate_label_for_chat' into feature/length_based_batch_sampling
|
il y a 1 an |
|
Matthias Reso
|
653a79e3dd
Invalidate context in labels for samsum + grammar
|
il y a 1 an |
|
Matthias Reso
|
d3015b4c80
Remove max_word from alpaca; lets deal tokenizer deal with truncation
|
il y a 1 an |
|
Hamid Shojanazeri
|
b7fd81c712
Updated quickstart notebook to use llama_recipes package (#224)
|
il y a 1 an |
|
Matthias Reso
|
a647955fc8
Make packing/padding a training setting
|
il y a 1 an |
|
Matthias Reso
|
2e768b1d1d
Added unit test coverage for amp
|
il y a 1 an |
|
Matthias Reso
|
33925f71e6
Add missing amp context if use_fp16 is enabled
|
il y a 1 an |
|
Hamid Shojanazeri
|
35b394e49f
adding profiler and flop_counter
|
il y a 1 an |
|
Hamid Shojanazeri
|
d56d5c469d
adding flop counter
|
il y a 1 an |
|
Hamid Shojanazeri
|
1ba9177645
minor updates (#228)
|
il y a 1 an |
 amitsangani
|
0190444849
minor updates
|
il y a 1 an |
|
Hamid Shojanazeri
|
e25bd3be25
Llama 2 Connect 2023 Colab Notebook (#227)
|
il y a 1 an |
|
amitsangani
|
b5267c515d
address comments
|
il y a 1 an |
|
Hamid Shojanazeri
|
3c620b2b29
clean up
|
il y a 1 an |
|
Hamid Shojanazeri
|
cd3a72ec35
fix format and missing packages
|
il y a 1 an |
|
amitsangani
|
636fd00d16
Llama 2 Connect 2023 Colab Notebook
|
il y a 1 an |
 Beto
|
7e7c8d2514
fixing typo on x label
|
il y a 1 an |
|
Beto
|
5a011246e1
Modularizing the graphs further. Plotting train and validation separetly due to difference in number of steps.
|
il y a 1 an |
|
Beto
|
9938afd088
condensed functionality in a single function for plotting both epoch and step metrics
|
il y a 1 an |
