This website works better with JavaScript
Home
Explore
Help
Register
Sign In
marx
/
llama-recipes
Watch
1
Star
0
Fork
0
Files
Issues
0
Pull Requests
0
Wiki
Browse Source
Update wordlist.txt
Hamid Shojanazeri
7 months ago
parent
c1be7d802a
commit
b49f31c300
1 changed files
with
5 additions
and
0 deletions
Split View
Show Diff Stats
5
0
scripts/spellcheck_conf/wordlist.txt
+ 5
- 0
scripts/spellcheck_conf/wordlist.txt
View File
@@ -1289,3 +1289,8 @@ tokenize
tokenizer's
tokenizers
warmup
+BOS
+EOS
+eot
+multiturn
+tiktoken