ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

vLLM CPU: Fix Triton Version to Resolve Related Error(#12893)

Browse source
This commit is contained in:
Xiangyu Tian 2025-02-25 15:00:41 +08:00 committed by GitHub
parent ab3fc66eb7
commit ae9f5320da
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docker/llm/serving/cpu/docker/Dockerfile
View file

@ -100,7 +100,7 @@ RUN apt-get update && apt-get install -y --no-install-recommends \
pip uninstall -y intel-extension-for-pytorch && \ pip uninstall -y intel-extension-for-pytorch && \
pip install -v -r requirements-cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu && \ pip install -v -r requirements-cpu.txt --extra-index-url https://download.pytorch.org/whl/cpu && \
VLLM_TARGET_DEVICE=cpu python3 setup.py install && \ VLLM_TARGET_DEVICE=cpu python3 setup.py install && \
pip install ray && \ pip install ray triton==3.1.0 && \
# Clean up unnecessary files to reduce image size # Clean up unnecessary files to reduce image size
rm -rf /var/lib/apt/lists/* rm -rf /var/lib/apt/lists/*