| .. |
|
configs
|
cc356b6017
Add FSDP CPU offloading option
|
1 year ago |
|
data
|
ddf58d205d
Added dist length based batch sampler
|
1 year ago |
|
datasets
|
ca41c1c697
Adjust tests to len based batch sampling
|
1 year ago |
|
inference
|
e554c1c8bf
The tokenizer will not add eos_token by default
|
1 year ago |
|
model_checkpointing
|
ce9501f22c
remove relative imports
|
1 year ago |
|
policies
|
ce9501f22c
remove relative imports
|
1 year ago |
|
utils
|
ddf58d205d
Added dist length based batch sampler
|
1 year ago |
|
finetuning.py
|
ca41c1c697
Adjust tests to len based batch sampling
|
1 year ago |
Matthias Reso
ddf58d205d
Added dist length based batch sampler