ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Switch to conhost when running on NPU (#11687)

Browse source
This commit is contained in:
Jin, Qiao 2024-07-30 17:08:06 +08:00 committed by GitHub
parent b119825152
commit a44ab32153
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 16 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
python/llm/example/NPU/HF-Transformers-AutoModels/LLM/README.md
View file

@ -45,6 +45,14 @@ pip install transformers==4.40
For optimal performance, it is recommended to set several environment variables. Please check out the suggestions based on your device. For optimal performance, it is recommended to set several environment variables. Please check out the suggestions based on your device.
#### 2.1 Configurations for Windows #### 2.1 Configurations for Windows
> [!NOTE]
> For optimal performance, we recommend running code in `conhost` rather than Windows Terminal:
> - Press <kbd>Win</kbd>+<kbd>R</kbd> and input `conhost`, then press Enter to launch `conhost`.
> - Run following command to use conda in `conhost`. Replace `<your conda install location>` with your conda install location.
> ```
> call <your conda install location>\Scripts\activate
> ```
**Following envrionment variables are required**: **Following envrionment variables are required**:
```cmd ```cmd

8
python/llm/example/NPU/HF-Transformers-AutoModels/Multimodal/README.md
View file

@ -35,6 +35,14 @@ pip install transformers==4.40
For optimal performance, it is recommended to set several environment variables. Please check out the suggestions based on your device. For optimal performance, it is recommended to set several environment variables. Please check out the suggestions based on your device.
#### 2.1 Configurations for Windows #### 2.1 Configurations for Windows
> [!NOTE]
> For optimal performance, we recommend running code in `conhost` rather than Windows Terminal:
> - Press <kbd>Win</kbd>+<kbd>R</kbd> and input `conhost`, then press Enter to launch `conhost`.
> - Run following command to use conda in `conhost`. Replace `<your conda install location>` with your conda install location.
> ```
> call <your conda install location>\Scripts\activate
> ```
**Following envrionment variables are required**: **Following envrionment variables are required**:
```cmd ```cmd