 Matthias Reso
|
147aaa29bc
Remove deprecated pytest_cmdline_preparse
|
преди 1 година |
|
Matthias Reso
|
0022d97163
remove decapoda-research/llama-7b-hf tokenizer and skip tests if meta-llama/Llama-2-7b is not available
|
преди 1 година |
|
Matthias Reso
|
53fd82355f
Add missing changes
|
преди 1 година |
|
Matthias Reso
|
8620ab8ac2
Fix invalid labels for context in custom dataset/oasst1
|
преди 1 година |
|
Matthias Reso
|
52c417b7d5
Merge branch 'fix/invalidate_label_for_chat' into feature/length_based_batch_sampling
|
преди 1 година |
|
Matthias Reso
|
eafea7b366
Invalidate labels in dialog dataset to disable loss
|
преди 1 година |
|
Matthias Reso
|
10f9367e56
fix missing labels in datasets
|
преди 1 година |
|
Matthias Reso
|
ca41c1c697
Adjust tests to len based batch sampling
|
преди 1 година |
|
Matthias Reso
|
eccf7cb3dc
Check additional example in resulting dataset
|
преди 1 година |
|
Matthias Reso
|
ec00a2f722
Fix batching error
|
преди 1 година |
|
Matthias Reso
|
dc507b4e55
Finish implementation oasst preprocessing for of custom dataset
|
преди 1 година |
|
Matthias Reso
|
26b9b7dbb2
Give an explicit error message if custom datset function is not found
|
преди 1 година |
|
Matthias Reso
|
9cb3fddfcf
Move datasets tests in their own subfolder
|
преди 1 година |
