 Joone Hur
|
83efccb22b
Add gradio library for user interface in inference.py
|
vor 1 Jahr |
 Hamid Shojanazeri
|
8776ceb833
update with the HF flash attention native
|
vor 1 Jahr |
|
Hamid Shojanazeri
|
dbfea484c6
Feature : Enable Intel GPU/XPU finetuning and inference (#116)
|
vor 1 Jahr |
 Beto
|
d92226a873
Removing option for local model, it's not working as expected. Would need further testing with the models from HF
|
vor 1 Jahr |
|
Beto
|
7881b3bb99
Changing safety utils to use HF classes to load Llama Guard. Removing Llama plain inference code
|
vor 1 Jahr |
|
Beto
|
109b728d02
Adding Llama Guard safety checker.
|
vor 1 Jahr |
 Abhilash Majumder
|
6a78b96764
Merge branch 'main' into ipex_feature
|
vor 1 Jahr |
 Matthias Reso
|
8ac44ef3be
Fix vocab size mismatch in inference due to added pad token
|
vor 1 Jahr |
 abhilash1910
|
ad6b27d316
merge conflicts
|
vor 1 Jahr |
|
abhilash1910
|
33da341af5
upstream resolve conflict
|
vor 1 Jahr |
|
Matthias Reso
|
ccda6fb8ca
Move inference scripts into example folder
|
vor 1 Jahr |
