ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

fix doc (#9599)

Browse source
This commit is contained in:
Guancheng Fu 2023-12-05 13:49:31 +08:00 committed by GitHub
parent f211f136b6
commit 8b00653039
2 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docker/llm/inference/xpu/docker/README.md
View file

@ -42,4 +42,4 @@ root@arda-arc12:/# sycl-ls
``` ```
To run inference using `BigDL-LLM` using xpu, you could refer to this [documentation](https://github.com/intel-analytics/BigDL/tree/main/python/llm/example/gpu). To run inference using `BigDL-LLM` using xpu, you could refer to this [documentation](https://github.com/intel-analytics/BigDL/tree/main/python/llm/example/GPU).

2
python/llm/example/GPU/vLLM-Serving/README.md
View file

@ -38,7 +38,7 @@ pip3 install psutil
pip3 install sentencepiece # Required for LLaMA tokenizer. pip3 install sentencepiece # Required for LLaMA tokenizer.
pip3 install numpy pip3 install numpy
pip3 install "transformers>=4.33.1" # Required for Code Llama. pip3 install "transformers>=4.33.1" # Required for Code Llama.
pip install --pre --upgrade bigdl-llm[xpu] -f https://developer.intel.com/ipex-whl-stable-xpu pip install --pre --upgrade "bigdl-llm[xpu]" -f https://developer.intel.com/ipex-whl-stable-xpu
pip3 install fastapi pip3 install fastapi
pip3 install "uvicorn[standard]" pip3 install "uvicorn[standard]"
pip3 install "pydantic<2" # Required for OpenAI server. pip3 install "pydantic<2" # Required for OpenAI server.