ipex-llm/docker/llm/serving/cpu
Xiangyu Tian b3f6faa038
LLM: Add CPU vLLM entrypoint (#11083)
Add CPU vLLM entrypoint and update CPU vLLM serving example.
2024-05-24 09:16:59 +08:00
..
docker LLM: Add CPU vLLM entrypoint (#11083) 2024-05-24 09:16:59 +08:00
kubernetes replace 2.5.0-SNAPSHOT with 2.1.0-SNAPSHOT for llm docker images (#10603) 2024-04-01 09:58:51 +08:00