ipex-llm/python/llm/src/ipex_llm/vllm/cpu
Xiangyu Tian b3f6faa038
LLM: Add CPU vLLM entrypoint (#11083)
Add CPU vLLM entrypoint and update CPU vLLM serving example.
2024-05-24 09:16:59 +08:00
..
engine LLM: Add CPU vLLM entrypoint (#11083) 2024-05-24 09:16:59 +08:00
entrypoints/openai LLM: Add CPU vLLM entrypoint (#11083) 2024-05-24 09:16:59 +08:00
__init__.py LLM: Add CPU vLLM entrypoint (#11083) 2024-05-24 09:16:59 +08:00
model_convert.py LLM: Add CPU vLLM entrypoint (#11083) 2024-05-24 09:16:59 +08:00