ipex-llm/python/llm/src/ipex_llm/vllm/cpu/engine
Xiangyu Tian b3f6faa038
LLM: Add CPU vLLM entrypoint (#11083)
Add CPU vLLM entrypoint and update CPU vLLM serving example.
2024-05-24 09:16:59 +08:00
..
__init__.py LLM: Add CPU vLLM entrypoint (#11083) 2024-05-24 09:16:59 +08:00
engine.py LLM: Add CPU vLLM entrypoint (#11083) 2024-05-24 09:16:59 +08:00