Upgrade to python 3.11 (#10711)
* create conda env with python 3.11 * recommend to use Python 3.11 * update
This commit is contained in:
parent
8f45e22072
commit
f37a1f2a81
217 changed files with 319 additions and 319 deletions
|
|
@ -17,7 +17,7 @@ Please refer to [Environment Setup](#environment-setup) for more information.
|
|||
|
||||
.. important::
|
||||
|
||||
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11; Python 3.9 is recommended for best practices.
|
||||
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11; Python 3.11 is recommended for best practices.
|
||||
```
|
||||
|
||||
## Recommended Requirements
|
||||
|
|
@ -39,10 +39,10 @@ Here list the recommended hardware and OS for smooth IPEX-LLM optimization exper
|
|||
|
||||
For optimal performance with LLM models using IPEX-LLM optimizations on Intel CPUs, here are some best practices for setting up environment:
|
||||
|
||||
First we recommend using [Conda](https://docs.conda.io/en/latest/miniconda.html) to create a python 3.9 enviroment:
|
||||
First we recommend using [Conda](https://docs.conda.io/en/latest/miniconda.html) to create a python 3.11 enviroment:
|
||||
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -22,10 +22,10 @@ To apply Intel GPU acceleration, there're several prerequisite steps for tools i
|
|||
|
||||
* Step 4: Install Intel® oneAPI Base Toolkit 2024.0:
|
||||
|
||||
First, Create a Python 3.9 enviroment and activate it. In Anaconda Prompt:
|
||||
First, Create a Python 3.11 enviroment and activate it. In Anaconda Prompt:
|
||||
|
||||
```cmd
|
||||
conda create -n llm python=3.9 libuv
|
||||
conda create -n llm python=3.11 libuv
|
||||
|
||||
conda activate llm
|
||||
```
|
||||
|
|
@ -33,7 +33,7 @@ To apply Intel GPU acceleration, there're several prerequisite steps for tools i
|
|||
```eval_rst
|
||||
.. important::
|
||||
|
||||
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.9 is recommended for best practices.
|
||||
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.11 is recommended for best practices.
|
||||
```
|
||||
|
||||
Then, use `pip` to install the Intel oneAPI Base Toolkit 2024.0:
|
||||
|
|
@ -111,7 +111,7 @@ pip install --pre --upgrade ipex-llm[xpu]
|
|||
```eval_rst
|
||||
.. note::
|
||||
|
||||
All the wheel packages mentioned here are for Python 3.9. If you would like to use Python 3.10 or 3.11, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp39`` with ``cp310`` or ``cp311``, respectively.
|
||||
All the wheel packages mentioned here are for Python 3.11. If you would like to use Python 3.9 or 3.10, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp39`` with ``cp310`` or ``cp311``, respectively.
|
||||
```
|
||||
|
||||
### Runtime Configuration
|
||||
|
|
@ -164,7 +164,7 @@ If you met error when importing `intel_extension_for_pytorch`, please ensure tha
|
|||
|
||||
* Ensure that `libuv` is installed in your conda environment. This can be done during the creation of the environment with the command:
|
||||
```cmd
|
||||
conda create -n llm python=3.9 libuv
|
||||
conda create -n llm python=3.11 libuv
|
||||
```
|
||||
If you missed `libuv`, you can add it to your existing environment through
|
||||
```cmd
|
||||
|
|
@ -399,12 +399,12 @@ IPEX-LLM GPU support on Linux has been verified on:
|
|||
### Install IPEX-LLM
|
||||
#### Install IPEX-LLM From PyPI
|
||||
|
||||
We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) to create a python 3.9 enviroment:
|
||||
We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) to create a python 3.11 enviroment:
|
||||
|
||||
```eval_rst
|
||||
.. important::
|
||||
|
||||
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.9 is recommended for best practices.
|
||||
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.11 is recommended for best practices.
|
||||
```
|
||||
|
||||
```eval_rst
|
||||
|
|
@ -422,7 +422,7 @@ We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) t
|
|||
|
||||
.. code-block:: bash
|
||||
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
|
||||
|
|
@ -439,7 +439,7 @@ We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) t
|
|||
|
||||
.. code-block:: bash
|
||||
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/cn/
|
||||
|
|
@ -461,7 +461,7 @@ We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) t
|
|||
|
||||
.. code-block:: bash
|
||||
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[xpu_2.0] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
|
||||
|
|
@ -470,7 +470,7 @@ We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) t
|
|||
|
||||
.. code-block:: bash
|
||||
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[xpu_2.0] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/cn/
|
||||
|
|
@ -530,7 +530,7 @@ If you encounter network issues when installing IPEX, you can also install IPEX-
|
|||
```eval_rst
|
||||
.. note::
|
||||
|
||||
All the wheel packages mentioned here are for Python 3.9. If you would like to use Python 3.10 or 3.11, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp39`` with ``cp310`` or ``cp311``, respectively.
|
||||
All the wheel packages mentioned here are for Python 3.11. If you would like to use Python 3.9 or 3.10, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp39`` with ``cp310`` or ``cp311``, respectively.
|
||||
```
|
||||
|
||||
### Runtime Configuration
|
||||
|
|
|
|||
|
|
@ -28,7 +28,7 @@ This guide walks you through setting up and running **Continue** within _Visual
|
|||
|
||||
Visit [Run Text Generation WebUI Quickstart Guide](webui_quickstart.html), and follow the steps 1) [Install IPEX-LLM](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#install-ipex-llm), 2) [Install WebUI](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#install-the-webui) and 3) [Start the Server](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#start-the-webui-server) to install and start the Text Generation WebUI API Service. **Please pay attention to below items during installation:**
|
||||
|
||||
- The Text Generation WebUI API service requires Python version 3.10 or higher. But [IPEX-LLM installation instructions](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#install-ipex-llm) used ``python=3.9`` as default for creating the conda environment. We recommend changing it to ``3.11``, using below command:
|
||||
- The Text Generation WebUI API service requires Python version 3.10 or higher. But [IPEX-LLM installation instructions](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#install-ipex-llm) used ``python=3.11`` as default for creating the conda environment. We recommend changing it to ``3.11``, using below command:
|
||||
```bash
|
||||
conda create -n llm python=3.11 libuv
|
||||
```
|
||||
|
|
|
|||
|
|
@ -144,7 +144,7 @@ You can use `conda --version` to verify you conda installation.
|
|||
|
||||
After installation, create a new python environment `llm`:
|
||||
```cmd
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
```
|
||||
Activate the newly created environment `llm`:
|
||||
```cmd
|
||||
|
|
|
|||
|
|
@ -57,7 +57,7 @@ Visit [Miniconda installation page](https://docs.anaconda.com/free/miniconda/),
|
|||
|
||||
Open the **Anaconda Prompt**. Then create a new python environment `llm` and activate it:
|
||||
```cmd
|
||||
conda create -n llm python=3.9 libuv
|
||||
conda create -n llm python=3.11 libuv
|
||||
conda activate llm
|
||||
```
|
||||
|
||||
|
|
|
|||
|
|
@ -26,7 +26,7 @@ Visit the [Install IPEX-LLM on Windows with Intel GPU Guide](https://ipex-llm.re
|
|||
|
||||
To use `llama.cpp` with IPEX-LLM, first ensure that `ipex-llm[cpp]` is installed.
|
||||
```cmd
|
||||
conda create -n llm-cpp python=3.9
|
||||
conda create -n llm-cpp python=3.11
|
||||
conda activate llm-cpp
|
||||
pip install --pre --upgrade ipex-llm[cpp]
|
||||
```
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ mkdir autogen
|
|||
cd autogen
|
||||
|
||||
# create respective conda environment
|
||||
conda create -n autogen python=3.9
|
||||
conda create -n autogen python=3.11
|
||||
conda activate autogen
|
||||
|
||||
# install fastchat-adapted ipex-llm
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ To run this example with IPEX-LLM, we have some recommended requirements for you
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ model = AutoModelForCausalLM.from_pretrained(model_name_or_path, load_in_4bit=Tr
|
|||
## Prepare Environment
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all]
|
||||
|
|
|
|||
|
|
@ -2,7 +2,7 @@
|
|||
|
||||
#### 1. Install Dependencies
|
||||
|
||||
Install necessary packages (here Python 3.9 is our test environment):
|
||||
Install necessary packages (here Python 3.11 is our test environment):
|
||||
|
||||
```bash
|
||||
bash install.sh
|
||||
|
|
|
|||
|
|
@ -34,7 +34,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a AWQ
|
|||
We suggest using conda to manage environment:
|
||||
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install autoawq==0.1.8 --no-deps
|
||||
|
|
|
|||
|
|
@ -25,7 +25,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Llam
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Baic
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Baic
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Blue
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Chat
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
@ -80,7 +80,7 @@ In the example [streamchat.py](./streamchat.py), we show a basic use case for a
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Chat
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
@ -81,7 +81,7 @@ In the example [streamchat.py](./streamchat.py), we show a basic use case for a
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Code
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Deci
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Deep
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Doll
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Doll
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Falc
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -14,7 +14,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default
|
||||
|
|
@ -27,7 +27,7 @@ pip install transformers==4.38.1
|
|||
#### 1.2 Installation on Windows
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9 libuv
|
||||
conda create -n llm python=3.11 libuv
|
||||
conda activate llm
|
||||
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default
|
||||
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Inte
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Inte
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Llam
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
# below command will install PyTorch CPU as default
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a MOSS
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for an MPT
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Phoe
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -15,7 +15,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Qwen
|
|||
We suggest using conda to manage environment:
|
||||
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Qwen
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a RedP
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Skyw
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a SOLA
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for an Sta
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Vicu
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [recognize.py](./recognize.py), we show a basic use case for a Wh
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
@ -66,7 +66,7 @@ In the example [long-segment-recognize.py](./long-segment-recognize.py), we show
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Wiza
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -5,7 +5,7 @@ In this example, we show a pipeline to apply IPEX-LLM low-bit optimizations (inc
|
|||
## Prepare Environment
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all]
|
||||
|
|
|
|||
|
|
@ -5,7 +5,7 @@ In this example, we show a pipeline to apply IPEX-LLM low-bit optimizations (inc
|
|||
## Prepare Environment
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all]
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Chat
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -7,7 +7,7 @@ In this example, we show a pipeline to convert a large language model to IPEX-LL
|
|||
## Prepare Environment
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all]
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [example_chat_completion.py](./example_chat_completion.py), we sh
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
# Install meta-llama repository
|
||||
|
|
|
|||
|
|
@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
# below command will install PyTorch CPU as default
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [recognize.py](./recognize.py), we show a basic use case for a Wh
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
|
|||
|
||||
After installing conda, create a Python environment for IPEX-LLM:
|
||||
```bash
|
||||
conda create -n llm python=3.9 # recommend to use Python 3.9
|
||||
conda create -n llm python=3.11 # recommend to use Python 3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option
|
||||
|
|
|
|||
|
|
@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case of low-bit
|
|||
### 1. Install
|
||||
We suggest using conda to manage environment:
|
||||
```bash
|
||||
conda create -n llm python=3.9
|
||||
conda create -n llm python=3.11
|
||||
conda activate llm
|
||||
|
||||
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option
|
||||
|
|
|
|||
Some files were not shown because too many files have changed in this diff Show more
Loading…
Reference in a new issue