ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update benchmark_vllm_throughput.py (#12414)

Browse source
This commit is contained in:
Guancheng Fu 2024-11-19 10:41:43 +08:00 committed by GitHub
parent a69395f31f
commit d6057f6dd2
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
docker/llm/serving/xpu/docker/benchmark_vllm_throughput.py
View file

@ -388,4 +388,5 @@ if __name__ == "__main__":
if args.tokenizer != args.model: if args.tokenizer != args.model:
raise ValueError("Tokenizer must be the same as the model for MII " raise ValueError("Tokenizer must be the same as the model for MII "
"backend.") "backend.")
main(args)