ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Fix cpu serving docker image (#12783)

Browse source
This commit is contained in:
Xiangyu Tian 2025-02-07 11:12:42 +08:00 committed by GitHub
parent b4c9e23f73
commit 9e9b6c9f2b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docker/llm/serving/cpu/docker/Dockerfile
View file

@ -28,7 +28,7 @@ RUN wget -qO /sbin/tini https://github.com/krallin/tini/releases/download/${TINI
cd ./vllm && \ cd ./vllm && \
git checkout v0.6.6.post1 && \ git checkout v0.6.6.post1 && \
pip install cmake>=3.26 wheel packaging ninja "setuptools-scm>=8" numpy && \ pip install cmake>=3.26 wheel packaging ninja "setuptools-scm>=8" numpy && \
pip uninstall intel-extension-for-pytorch && \ pip uninstall -y intel-extension-for-pytorch && \
pip install -v -r requirements-cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu && \ pip install -v -r requirements-cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu && \
VLLM_TARGET_DEVICE=cpu python3 setup.py install && \ VLLM_TARGET_DEVICE=cpu python3 setup.py install && \
pip install ray pip install ray