ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Fix vllm service error (#10279)

Browse source
This commit is contained in:
Lilac09 2024-02-29 15:45:04 +08:00 committed by GitHub
parent 4e6cc424f1
commit a2ed4d714e
1 changed files with 2 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docker/llm/inference/cpu/docker/Dockerfile
View file

@ -48,6 +48,8 @@ RUN env DEBIAN_FRONTEND=noninteractive apt-get update && \
# Copy vLLM-Serving # Copy vLLM-Serving
cp -r ./BigDL/python/llm/example/CPU/vLLM-Serving/ ./vLLM-Serving && \ cp -r ./BigDL/python/llm/example/CPU/vLLM-Serving/ ./vLLM-Serving && \
rm -rf ./BigDL && \ rm -rf ./BigDL && \
# Fix vllm service
pip install pydantic==1.10.11 && \
# Install miniconda # Install miniconda
curl -LO "https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh" && \ curl -LO "https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh" && \
bash Miniconda3-latest-Linux-x86_64.sh -b && \ bash Miniconda3-latest-Linux-x86_64.sh -b && \