ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Remove bigdl-nano and add ipex into inference-cpu image (#9452)

Browse source 
* remove bigdl-nano and add ipex into inference-cpu image

* remove bigdl-nano in docker

* remove bigdl-nano in docker
This commit is contained in:
Lilac09 2023-11-14 10:50:52 +08:00 committed by GitHub
parent 0f78ebe35e
commit b2b085550b
2 changed files with 0 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
docker/llm/inference/cpu/docker/Dockerfile
View file

@ -25,7 +25,6 @@ RUN env DEBIAN_FRONTEND=noninteractive apt-get update && \
pip install --upgrade requests argparse urllib3 && \ pip install --upgrade requests argparse urllib3 && \
pip3 install --no-cache-dir --upgrade torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu && \ pip3 install --no-cache-dir --upgrade torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu && \
pip install --pre --upgrade bigdl-llm[all] && \ pip install --pre --upgrade bigdl-llm[all] && \
pip install --pre --upgrade bigdl-nano && \
# Download bigdl-llm-tutorial # Download bigdl-llm-tutorial
cd /llm && \ cd /llm && \
pip install --upgrade jupyterlab && \ pip install --upgrade jupyterlab && \

2
docker/llm/serving/cpu/docker/entrypoint.sh
View file

@ -171,8 +171,6 @@ else
else else
# Logic for non-controller(worker) mode # Logic for non-controller(worker) mode
worker_address="http://$worker_host:$worker_port" worker_address="http://$worker_host:$worker_port"
# Apply optimizations from bigdl-nano
source bigdl-nano-init -t
# First check if user have set OMP_NUM_THREADS by themselves # First check if user have set OMP_NUM_THREADS by themselves
if [[ -n "${omp_num_threads}" ]]; then if [[ -n "${omp_num_threads}" ]]; then
echo "Setting OMP_NUM_THREADS to its original value: $omp_num_threads" echo "Setting OMP_NUM_THREADS to its original value: $omp_num_threads"