Procházet zdrojové kódy

Reorg inference throughput folder structure (#404)

Hamid Shojanazeri před 11 měsíci
rodič
revize
6a7478a6aa

recipes/benchmarks/inference/README.md → recipes/benchmarks/inference_throughput/README.md


recipes/benchmarks/inference/on-prem/README.md → recipes/benchmarks/inference_throughput/on-prem/README.md


recipes/benchmarks/inference/on-prem/vllm/chat_vllm_benchmark.py → recipes/benchmarks/inference_throughput/on-prem/vllm/chat_vllm_benchmark.py


recipes/benchmarks/inference/on-prem/vllm/input.jsonl → recipes/benchmarks/inference_throughput/on-prem/vllm/input.jsonl


recipes/benchmarks/inference/on-prem/vllm/parameters.json → recipes/benchmarks/inference_throughput/on-prem/vllm/parameters.json


recipes/benchmarks/inference/on-prem/vllm/pretrained_vllm_benchmark.py → recipes/benchmarks/inference_throughput/on-prem/vllm/pretrained_vllm_benchmark.py


recipes/benchmarks/inference/tokenizer/special_tokens_map.json → recipes/benchmarks/inference_throughput/tokenizer/special_tokens_map.json


recipes/benchmarks/inference/tokenizer/tokenizer.json → recipes/benchmarks/inference_throughput/tokenizer/tokenizer.json


recipes/benchmarks/inference/tokenizer/tokenizer.model → recipes/benchmarks/inference_throughput/tokenizer/tokenizer.model


recipes/benchmarks/inference/tokenizer/tokenizer_config.json → recipes/benchmarks/inference_throughput/tokenizer/tokenizer_config.json