ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update gpu spec decoding baichuan2 example dependency (#9990)

Browse source 
* add dependency

* update

* update
This commit is contained in:
Yina Chen 2024-01-25 11:05:04 +08:00 committed by GitHub
parent 27338540c3
commit 99ff6cf048
2 changed files with 1 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
python/llm/example/GPU/Speculative-Decoding/baichuan2/README.md
View file

@ -13,7 +13,7 @@ conda create -n llm python=3.9
conda activate llm conda activate llm
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default # below command will install intel_extension_for_pytorch==2.1.10+xpu as default
pip install --pre --upgrade bigdl-llm[xpu] -f https://developer.intel.com/ipex-whl-stable-xpu pip install --pre --upgrade bigdl-llm[xpu] -f https://developer.intel.com/ipex-whl-stable-xpu
pip install transformers==4.34.0 pip install transformers_stream_generator # additional package required for Baichuan-7B-Chat to conduct generation
``` ```
### 2. Configures OneAPI environment variables ### 2. Configures OneAPI environment variables
```bash ```bash

1
python/llm/example/GPU/Speculative-Decoding/qwen/README.md
View file

@ -13,7 +13,6 @@ conda create -n llm python=3.9
conda activate llm conda activate llm
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default # below command will install intel_extension_for_pytorch==2.1.10+xpu as default
pip install --pre --upgrade bigdl-llm[xpu] -f https://developer.intel.com/ipex-whl-stable-xpu pip install --pre --upgrade bigdl-llm[xpu] -f https://developer.intel.com/ipex-whl-stable-xpu
pip install transformers==4.34.0
``` ```
### 2. Configures OneAPI environment variables ### 2. Configures OneAPI environment variables
```bash ```bash