ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Add ipex-llm npu option in setup.py (#11858)

Browse source 
* add ipex-llm npu release

* update example doc

* meet latest release changes
This commit is contained in:
SONG Ge 2024-08-20 17:29:49 +08:00 committed by GitHub
parent ee6852c915
commit 5b83493b1a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 9 additions and 5 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
python/llm/example/NPU/HF-Transformers-AutoModels/LLM/README.md
View file

@ -91,11 +91,8 @@ We suggest using conda to manage environment:
conda create -n llm python=3.10 conda create -n llm python=3.10
conda activate llm conda activate llm
# install ipex-llm with 'all' option # install ipex-llm with 'npu' option
pip install --pre --upgrade ipex-llm[all] pip install --pre --upgrade ipex-llm[npu]
pip install --pre --upgrade bigdl-core-npu
pip install transformers==4.40
``` ```
### 2. Runtime Configurations ### 2. Runtime Configurations

7
python/llm/setup.py
View file

@ -300,6 +300,12 @@ def setup_package():
serving_requires = ['py-cpuinfo'] serving_requires = ['py-cpuinfo']
serving_requires += SERVING_DEP serving_requires += SERVING_DEP
npu_requires = copy.deepcopy(all_requires)
cpu_transformers_version = ['transformers == 4.37.0', 'tokenizers == 0.15.2']
for exclude_require in cpu_transformers_version:
npu_requires.remove(exclude_require)
npu_requires += ["transformers==4.40.0",
"bigdl-core-npu==" + CORE_XE_VERSION + ";platform_system=='Windows'"]
metadata = dict( metadata = dict(
name='ipex_llm', name='ipex_llm',
@ -323,6 +329,7 @@ def setup_package():
}, },
extras_require={"all": all_requires, extras_require={"all": all_requires,
"xpu": xpu_requires, # default to ipex 2.1 for linux and windows "xpu": xpu_requires, # default to ipex 2.1 for linux and windows
"npu": npu_requires,
"xpu-2-1": xpu_21_requires, "xpu-2-1": xpu_21_requires,
"serving": serving_requires, "serving": serving_requires,
"cpp": cpp_requires, "cpp": cpp_requires,