소스 검색

update readme

Hamid Shojanazeri 1 년 전
부모
커밋
0854a74df1
1개의 변경된 파일2개의 추가작업 그리고 2개의 파일을 삭제
  1. 2 2
      docs/inference.md

+ 2 - 2
docs/inference.md

@@ -79,11 +79,11 @@ To run the code infilling example:
 python examples/code_llama/code_infilling_example.py --model_name MODEL_NAME --prompt_file examples/code_llama/code_infilling_prompt.txt --temperature 0.2 --top_p 0.9
 
 ```
-To run the 70B Instruct model example run the following, it asks for system and user prompt to instruct the model:
+To run the 70B Instruct model example run the following (you'll need to enter the system and user prompts to instruct the model):
 
 ```bash
 
-python code_instruct_example.py --model_name codellama/CodeLlama-70b-Instruct-hf
+python examples/code_llama/code_instruct_example.py --model_name codellama/CodeLlama-70b-Instruct-hf --temperature 0.2 --top_p 0.9
 
 ```
 You can learn more about the chat prompt template [on HF](https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf#chat-prompt) and [original Code Llama repository](https://github.com/facebookresearch/codellama/blob/main/README.md#fine-tuned-instruction-models). HF tokenizer has already taken care of the chat template as shown in this example.