Browse Source

Reorg inference throughput folder structure

Chester Hu 1 năm trước cách đây
mục cha
commit
367e4869ac

recipes/benchmarks/inference/README.md → recipes/benchmarks/inference_throughput/README.md


recipes/benchmarks/inference/on-prem/README.md → recipes/benchmarks/inference_throughput/on-prem/README.md


recipes/benchmarks/inference/on-prem/vllm/chat_vllm_benchmark.py → recipes/benchmarks/inference_throughput/on-prem/vllm/chat_vllm_benchmark.py


recipes/benchmarks/inference/on-prem/vllm/input.jsonl → recipes/benchmarks/inference_throughput/on-prem/vllm/input.jsonl


recipes/benchmarks/inference/on-prem/vllm/parameters.json → recipes/benchmarks/inference_throughput/on-prem/vllm/parameters.json


recipes/benchmarks/inference/on-prem/vllm/pretrained_vllm_benchmark.py → recipes/benchmarks/inference_throughput/on-prem/vllm/pretrained_vllm_benchmark.py


recipes/benchmarks/inference/tokenizer/special_tokens_map.json → recipes/benchmarks/inference_throughput/tokenizer/special_tokens_map.json


recipes/benchmarks/inference/tokenizer/tokenizer.json → recipes/benchmarks/inference_throughput/tokenizer/tokenizer.json


recipes/benchmarks/inference/tokenizer/tokenizer.model → recipes/benchmarks/inference_throughput/tokenizer/tokenizer.model


recipes/benchmarks/inference/tokenizer/tokenizer_config.json → recipes/benchmarks/inference_throughput/tokenizer/tokenizer_config.json