ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

[NPU doc] Add ARL runtime configuration (#12562)

Browse source
This commit is contained in:
binbin Deng 2024-12-17 16:08:42 +08:00 committed by GitHub
parent 429bf1ffeb
commit 694d14b2b4
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 7 additions and 6 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

13
docs/mddocs/Quickstart/npu_quickstart.md
View file

@ -88,20 +88,21 @@ For `ipex-llm` NPU support, please set the following environment variable with a
- For **Intel Core™ Ultra Processors (Series 2) with processor number 2xxV (code name Lunar Lake)**: - For **Intel Core™ Ultra Processors (Series 2) with processor number 2xxV (code name Lunar Lake)**:
- For Intel Core™ Ultra 7 Processor 258V: - For Intel Core™ Ultra 7 Processor 258V:
```cmd No runtime configuration required.
set BIGDL_USE_NPU=1
```
- For Intel Core™ Ultra 5 Processor 228V & 226V: - For Intel Core™ Ultra 5 Processor 228V & 226V:
```cmd ```cmd
set BIGDL_USE_NPU=1
set IPEX_LLM_NPU_DISABLE_COMPILE_OPT=1 set IPEX_LLM_NPU_DISABLE_COMPILE_OPT=1
``` ```
- For **Intel Core™ Ultra Processors (Series 2) with processor number 2xxK (code name Arrow Lake)**:
```cmd
set IPEX_LLM_NPU_DISABLE_COMPILE_OPT=1
```
- For **Intel Core™ Ultra Processors (Series 1) with processor number 1xxH (code name Meteor Lake)**: - For **Intel Core™ Ultra Processors (Series 1) with processor number 1xxH (code name Meteor Lake)**:
```bash ```cmd
set BIGDL_USE_NPU=1
set IPEX_LLM_NPU_MTL=1 set IPEX_LLM_NPU_MTL=1
``` ```