Update Windows guide regarding LNL support (#12178)
* Update windows guide regarding LNL support * Update based on comments
This commit is contained in:
parent
0ef7e1d101
commit
ac44e98b7d
2 changed files with 115 additions and 35 deletions
|
|
@ -44,9 +44,35 @@ We recommend using [Miniforge](https://conda-forge.org/download/) to create a py
|
||||||
> [!IMPORTANT]
|
> [!IMPORTANT]
|
||||||
> ``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.11 is recommended for best practices.
|
> ``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.11 is recommended for best practices.
|
||||||
|
|
||||||
The easiest ways to install `ipex-llm` is the following commands, choosing either US or CN website for `extra-index-url`:
|
The easiest ways to install `ipex-llm` is the following commands.
|
||||||
|
|
||||||
- For **US**:
|
- For **Intel Core™ Ultra Series 2 (a.k.a. Lunar Lake) with Intel Arc™ Graphics**:
|
||||||
|
|
||||||
|
Choose either US or CN website for `extra-index-url`:
|
||||||
|
|
||||||
|
- For **US**:
|
||||||
|
|
||||||
|
```cmd
|
||||||
|
conda create -n llm python=3.11 libuv
|
||||||
|
conda activate llm
|
||||||
|
|
||||||
|
pip install --pre --upgrade ipex-llm[xpu_lnl] --extra-index-url --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/lnl/us/
|
||||||
|
```
|
||||||
|
|
||||||
|
- For **CN**:
|
||||||
|
|
||||||
|
```cmd
|
||||||
|
conda create -n llm python=3.11 libuv
|
||||||
|
conda activate llm
|
||||||
|
|
||||||
|
pip install --pre --upgrade ipex-llm[xpu_lnl] --extra-index-url --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/lnl/cn/
|
||||||
|
```
|
||||||
|
|
||||||
|
- For **other Intel iGPU and dGPU**:
|
||||||
|
|
||||||
|
Choose either US or CN website for `extra-index-url`:
|
||||||
|
|
||||||
|
- For **US**:
|
||||||
|
|
||||||
```cmd
|
```cmd
|
||||||
conda create -n llm python=3.11 libuv
|
conda create -n llm python=3.11 libuv
|
||||||
|
|
@ -55,7 +81,7 @@ The easiest ways to install `ipex-llm` is the following commands, choosing eithe
|
||||||
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
|
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
|
||||||
```
|
```
|
||||||
|
|
||||||
- For **CN**:
|
- For **CN**:
|
||||||
|
|
||||||
```cmd
|
```cmd
|
||||||
conda create -n llm python=3.11 libuv
|
conda create -n llm python=3.11 libuv
|
||||||
|
|
@ -68,23 +94,45 @@ The easiest ways to install `ipex-llm` is the following commands, choosing eithe
|
||||||
|
|
||||||
If you encounter network issues when installing IPEX, you can also install IPEX-LLM dependencies for Intel XPU from source archives. First you need to download and install torch/torchvision/ipex from wheels listed below before installing `ipex-llm`.
|
If you encounter network issues when installing IPEX, you can also install IPEX-LLM dependencies for Intel XPU from source archives. First you need to download and install torch/torchvision/ipex from wheels listed below before installing `ipex-llm`.
|
||||||
|
|
||||||
Download the wheels on Windows system:
|
- For **Intel Core™ Ultra Series 2 (a.k.a. Lunar Lake) with Intel Arc™ Graphics**:
|
||||||
|
|
||||||
```
|
Download the wheels on Windows system:
|
||||||
wget https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/torch-2.1.0a0%2Bcxx11.abi-cp311-cp311-win_amd64.whl
|
|
||||||
wget https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/torchvision-0.16.0a0%2Bcxx11.abi-cp311-cp311-win_amd64.whl
|
|
||||||
wget https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/intel_extension_for_pytorch-2.1.10%2Bxpu-cp311-cp311-win_amd64.whl
|
|
||||||
```
|
|
||||||
|
|
||||||
You may install dependencies directly from the wheel archives and then install `ipex-llm` using following commands:
|
```
|
||||||
|
wget https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/lnl/torch-2.3.1%2Bcxx11.abi-cp311-cp311-win_amd64.whl
|
||||||
|
wget https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/lnl/torchvision-0.18.1%2Bcxx11.abi-cp311-cp311-win_amd64.whl
|
||||||
|
wget https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/lnl/intel_extension_for_pytorch-2.3.110%2Bxpu-cp311-cp311-win_amd64.whl
|
||||||
|
```
|
||||||
|
|
||||||
```
|
You may install dependencies directly from the wheel archives and then install `ipex-llm` using following commands:
|
||||||
pip install torch-2.1.0a0+cxx11.abi-cp311-cp311-win_amd64.whl
|
|
||||||
pip install torchvision-0.16.0a0+cxx11.abi-cp311-cp311-win_amd64.whl
|
|
||||||
pip install intel_extension_for_pytorch-2.1.10+xpu-cp311-cp311-win_amd64.whl
|
|
||||||
|
|
||||||
pip install --pre --upgrade ipex-llm[xpu]
|
```
|
||||||
```
|
pip install torch-2.3.1+cxx11.abi-cp311-cp311-win_amd64.whl
|
||||||
|
pip install torchvision-0.18.1+cxx11.abi-cp311-cp311-win_amd64.whl
|
||||||
|
pip install intel_extension_for_pytorch-2.3.110+xpu-cp311-cp311-win_amd64.whl
|
||||||
|
|
||||||
|
pip install --pre --upgrade ipex-llm[xpu_lnl]
|
||||||
|
```
|
||||||
|
|
||||||
|
- For **other Intel iGPU and dGPU**:
|
||||||
|
|
||||||
|
Download the wheels on Windows system:
|
||||||
|
|
||||||
|
```
|
||||||
|
wget https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/torch-2.1.0a0%2Bcxx11.abi-cp311-cp311-win_amd64.whl
|
||||||
|
wget https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/torchvision-0.16.0a0%2Bcxx11.abi-cp311-cp311-win_amd64.whl
|
||||||
|
wget https://intel-extension-for-pytorch.s3.amazonaws.com/ipex_stable/xpu/intel_extension_for_pytorch-2.1.10%2Bxpu-cp311-cp311-win_amd64.whl
|
||||||
|
```
|
||||||
|
|
||||||
|
You may install dependencies directly from the wheel archives and then install `ipex-llm` using following commands:
|
||||||
|
|
||||||
|
```
|
||||||
|
pip install torch-2.1.0a0+cxx11.abi-cp311-cp311-win_amd64.whl
|
||||||
|
pip install torchvision-0.16.0a0+cxx11.abi-cp311-cp311-win_amd64.whl
|
||||||
|
pip install intel_extension_for_pytorch-2.1.10+xpu-cp311-cp311-win_amd64.whl
|
||||||
|
|
||||||
|
pip install --pre --upgrade ipex-llm[xpu]
|
||||||
|
```
|
||||||
|
|
||||||
> [!NOTE]
|
> [!NOTE]
|
||||||
> All the wheel packages mentioned here are for Python 3.11. If you would like to use Python 3.9 or 3.10, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp11`` with ``cp39`` or ``cp310``, respectively.
|
> All the wheel packages mentioned here are for Python 3.11. If you would like to use Python 3.9 or 3.10, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp11`` with ``cp39`` or ``cp310``, respectively.
|
||||||
|
|
|
||||||
|
|
@ -45,17 +45,49 @@ conda activate llm
|
||||||
|
|
||||||
## Install `ipex-llm`
|
## Install `ipex-llm`
|
||||||
|
|
||||||
With the `llm` environment active, use `pip` to install `ipex-llm` for GPU. Choose either US or CN website for `extra-index-url`:
|
With the `llm` environment active, use `pip` to install `ipex-llm` for GPU:
|
||||||
|
|
||||||
- For **US**:
|
- For **Intel Core™ Ultra Series 2 (a.k.a. Lunar Lake) with Intel Arc™ Graphics**:
|
||||||
|
|
||||||
|
Choose either US or CN website for `extra-index-url`:
|
||||||
|
|
||||||
|
- For **US**:
|
||||||
|
|
||||||
|
```cmd
|
||||||
|
conda create -n llm python=3.11 libuv
|
||||||
|
conda activate llm
|
||||||
|
|
||||||
|
pip install --pre --upgrade ipex-llm[xpu_lnl] --extra-index-url --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/lnl/us/
|
||||||
|
```
|
||||||
|
|
||||||
|
- For **CN**:
|
||||||
|
|
||||||
|
```cmd
|
||||||
|
conda create -n llm python=3.11 libuv
|
||||||
|
conda activate llm
|
||||||
|
|
||||||
|
pip install --pre --upgrade ipex-llm[xpu_lnl] --extra-index-url --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/lnl/cn/
|
||||||
|
```
|
||||||
|
|
||||||
|
- For **other Intel iGPU and dGPU**:
|
||||||
|
|
||||||
|
Choose either US or CN website for `extra-index-url`:
|
||||||
|
|
||||||
|
- For **US**:
|
||||||
|
|
||||||
|
```cmd
|
||||||
|
conda create -n llm python=3.11 libuv
|
||||||
|
conda activate llm
|
||||||
|
|
||||||
```bash
|
|
||||||
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
|
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
|
||||||
```
|
```
|
||||||
|
|
||||||
- For **CN**:
|
- For **CN**:
|
||||||
|
|
||||||
|
```cmd
|
||||||
|
conda create -n llm python=3.11 libuv
|
||||||
|
conda activate llm
|
||||||
|
|
||||||
```bash
|
|
||||||
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/cn/
|
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/cn/
|
||||||
```
|
```
|
||||||
|
|
||||||
|
|
|
||||||
Loading…
Reference in a new issue