ipex-llm/docker/llm/serving
Guancheng Fu 2c64754eb0
Add vLLM to ipex-llm serving image (#10807)
* add vllm

* done

* doc work

* fix done

* temp

* add docs

* format

* add start-fastchat-service.sh

* fix
2024-04-29 17:25:42 +08:00
..
cpu Upgrade python to 3.11 in Docker Image (#10718) 2024-04-10 14:41:27 +08:00
xpu/docker Add vLLM to ipex-llm serving image (#10807) 2024-04-29 17:25:42 +08:00