ipex-llm/python
Xiangyu Tian 0ea842231e [LLM] vLLM: Add api_server entrypoint (#9783)
Add vllm.entrypoints.api_server for benchmark_serving.py in vllm.
2023-12-26 16:03:57 +08:00
..
llm [LLM] vLLM: Add api_server entrypoint (#9783) 2023-12-26 16:03:57 +08:00