ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

add chat.py denpendency in Dockerfile (#9699)

Browse source
This commit is contained in:
Lilac09 2023-12-18 09:00:22 +08:00 committed by GitHub
parent c00a9144c4
commit a5c481fedd
2 changed files with 4 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docker/llm/README.md
View file

@ -73,7 +73,7 @@ You can download models and bind the model directory from host machine to contai
After entering the container through `docker exec`, you can run chat.py by: After entering the container through `docker exec`, you can run chat.py by:
```bash ```bash
cd /llm cd /llm/portable-zip
python chat.py --model-path YOUR_MODEL_PATH python chat.py --model-path YOUR_MODEL_PATH
``` ```
If your model is chatglm-6b and mounted on /llm/models, you can excute: If your model is chatglm-6b and mounted on /llm/models, you can excute:

6
docker/llm/inference/cpu/docker/Dockerfile
View file

@ -30,12 +30,12 @@ RUN env DEBIAN_FRONTEND=noninteractive apt-get update && \
pip install --upgrade jupyterlab && \ pip install --upgrade jupyterlab && \
git clone https://github.com/intel-analytics/bigdl-llm-tutorial && \ git clone https://github.com/intel-analytics/bigdl-llm-tutorial && \
chmod +x /llm/start-notebook.sh && \ chmod +x /llm/start-notebook.sh && \
# Download chat.py script
pip install --upgrade colorama && \
wget -P /llm https://raw.githubusercontent.com/intel-analytics/BigDL/main/python/llm/portable-zip/chat.py && \
# Download all-in-one benchmark # Download all-in-one benchmark
git clone https://github.com/intel-analytics/BigDL && \ git clone https://github.com/intel-analytics/BigDL && \
cp -r ./BigDL/python/llm/dev/benchmark/ ./benchmark && \ cp -r ./BigDL/python/llm/dev/benchmark/ ./benchmark && \
# Copy chat.py script
pip install --upgrade colorama && \
cp -r ./BigDL/python/llm/portable-zip/ ./portable-zip && \
# Install all-in-one dependencies # Install all-in-one dependencies
apt-get install -y numactl && \ apt-get install -y numactl && \
pip install --upgrade omegaconf && \ pip install --upgrade omegaconf && \