ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Add mtl AOT packages in faq.md (#11577)

Browse source 
* Update faq.md

* Update faq.md

* Update faq.md

* Update faq.md

* Update faq.md
This commit is contained in:
Xin Qiu 2024-07-16 08:46:03 +08:00 committed by GitHub
parent 50cf563a71
commit 91409ffe8c
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 10 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

11
docs/mddocs/Overview/FAQ/faq.md
View file

@ -88,4 +88,13 @@ You may encounter this error during finetuning, expecially when run 70B model. P
### `RuntimeError: could not create a primitive` on Windows
This error may happen when multiple GPUs exists for Windows Users. To solve this error, you can open Device Manager (search "Device Manager" in your start menu). Then click the "Display adapter" option, and disable all the GPU device you do not want to use. Restart your computer and try again. IPEX-LLM should work fine this time.
This error may happen when multiple GPUs exists for Windows Users. To solve this error, you can open Device Manager (search "Device Manager" in your start menu). Then click the "Display adapter" option, and disable all the GPU device you do not want to use. Restart your computer and try again. IPEX-LLM should work fine this time.
### The first time to run model on Meteor Lake's iGPU(Intel Core™ Ultra integrated GPU) will takes 5-10 minutes.
This is caused by intel-extension-for-pytorch's compilation. For windows user, you can install this [intel-extension-for-pytorch](https://github.com/Nuullll/intel-extension-for-pytorch/releases) with Meteor Lake's [ahead-of-time-compilation](https://www.intel.com/content/www/us/en/docs/dpcpp-cpp-compiler/developer-guide-reference/2023-0/ahead-of-time-compilation.html).
Please notice the packages only support python 3.10, you can use below commands after you have installed ipex-llm[xpu]:
```bash
pip install https://github.com/Nuullll/intel-extension-for-pytorch/releases/download/v2.1.20%2Bmtl%2Boneapi/intel_extension_for_pytorch-2.1.20+git4849f3b-cp310-cp310-win_amd64.whl
pip install https://github.com/Nuullll/intel-extension-for-pytorch/releases/download/v2.1.20%2Bmtl%2Boneapi/torch-2.1.0a0+git7bcf7da-cp310-cp310-win_amd64.whl
pip install https://github.com/Nuullll/intel-extension-for-pytorch/releases/download/v2.1.20%2Bmtl%2Boneapi/torchvision-0.16.0+fbb4cc5-cp310-cp310-win_amd64.whl
```