Commit History

Author SHA1 Message Date
  Matthias Reso 6d9d48d619 Use apply_chat_template instead of custom functions 11 months ago
  Matthias Reso a414ca6a57 Update chat format for llama3 1 year ago
  Yuanhao e554c1c8bf The tokenizer will not add eos_token by default 1 year ago
  Matthias Reso cf678b9bf0 Adjust imports to package structure + cleaned up imports 1 year ago
  Matthias Reso 4c9cc7d223 Move modules into separate src folder 1 year ago