Upgrade to python 3.11 (#10711)

* create conda env with python 3.11

* recommend to use Python 3.11

* update
This commit is contained in:
Shaojun Liu 2024-04-09 17:41:17 +08:00 committed by GitHub
parent 8f45e22072
commit f37a1f2a81
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
217 changed files with 319 additions and 319 deletions

View file

@ -17,7 +17,7 @@ Please refer to [Environment Setup](#environment-setup) for more information.
.. important::
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11; Python 3.9 is recommended for best practices.
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11; Python 3.11 is recommended for best practices.
```
## Recommended Requirements
@ -39,10 +39,10 @@ Here list the recommended hardware and OS for smooth IPEX-LLM optimization exper
For optimal performance with LLM models using IPEX-LLM optimizations on Intel CPUs, here are some best practices for setting up environment:
First we recommend using [Conda](https://docs.conda.io/en/latest/miniconda.html) to create a python 3.9 enviroment:
First we recommend using [Conda](https://docs.conda.io/en/latest/miniconda.html) to create a python 3.11 enviroment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -22,10 +22,10 @@ To apply Intel GPU acceleration, there're several prerequisite steps for tools i
* Step 4: Install Intel® oneAPI Base Toolkit 2024.0:
First, Create a Python 3.9 enviroment and activate it. In Anaconda Prompt:
First, Create a Python 3.11 enviroment and activate it. In Anaconda Prompt:
```cmd
conda create -n llm python=3.9 libuv
conda create -n llm python=3.11 libuv
conda activate llm
```
@ -33,7 +33,7 @@ To apply Intel GPU acceleration, there're several prerequisite steps for tools i
```eval_rst
.. important::
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.9 is recommended for best practices.
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.11 is recommended for best practices.
```
Then, use `pip` to install the Intel oneAPI Base Toolkit 2024.0:
@ -111,7 +111,7 @@ pip install --pre --upgrade ipex-llm[xpu]
```eval_rst
.. note::
All the wheel packages mentioned here are for Python 3.9. If you would like to use Python 3.10 or 3.11, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp39`` with ``cp310`` or ``cp311``, respectively.
All the wheel packages mentioned here are for Python 3.11. If you would like to use Python 3.9 or 3.10, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp39`` with ``cp310`` or ``cp311``, respectively.
```
### Runtime Configuration
@ -164,7 +164,7 @@ If you met error when importing `intel_extension_for_pytorch`, please ensure tha
* Ensure that `libuv` is installed in your conda environment. This can be done during the creation of the environment with the command:
```cmd
conda create -n llm python=3.9 libuv
conda create -n llm python=3.11 libuv
```
If you missed `libuv`, you can add it to your existing environment through
```cmd
@ -399,12 +399,12 @@ IPEX-LLM GPU support on Linux has been verified on:
### Install IPEX-LLM
#### Install IPEX-LLM From PyPI
We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) to create a python 3.9 enviroment:
We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) to create a python 3.11 enviroment:
```eval_rst
.. important::
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.9 is recommended for best practices.
``ipex-llm`` is tested with Python 3.9, 3.10 and 3.11. Python 3.11 is recommended for best practices.
```
```eval_rst
@ -422,7 +422,7 @@ We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) t
.. code-block:: bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
@ -439,7 +439,7 @@ We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) t
.. code-block:: bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/cn/
@ -461,7 +461,7 @@ We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) t
.. code-block:: bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[xpu_2.0] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
@ -470,7 +470,7 @@ We recommend using [miniconda](https://docs.conda.io/en/latest/miniconda.html) t
.. code-block:: bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[xpu_2.0] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/cn/
@ -530,7 +530,7 @@ If you encounter network issues when installing IPEX, you can also install IPEX-
```eval_rst
.. note::
All the wheel packages mentioned here are for Python 3.9. If you would like to use Python 3.10 or 3.11, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp39`` with ``cp310`` or ``cp311``, respectively.
All the wheel packages mentioned here are for Python 3.11. If you would like to use Python 3.9 or 3.10, you should modify the wheel names for ``torch``, ``torchvision``, and ``intel_extension_for_pytorch`` by replacing ``cp39`` with ``cp310`` or ``cp311``, respectively.
```
### Runtime Configuration

View file

@ -28,7 +28,7 @@ This guide walks you through setting up and running **Continue** within _Visual
Visit [Run Text Generation WebUI Quickstart Guide](webui_quickstart.html), and follow the steps 1) [Install IPEX-LLM](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#install-ipex-llm), 2) [Install WebUI](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#install-the-webui) and 3) [Start the Server](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#start-the-webui-server) to install and start the Text Generation WebUI API Service. **Please pay attention to below items during installation:**
- The Text Generation WebUI API service requires Python version 3.10 or higher. But [IPEX-LLM installation instructions](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#install-ipex-llm) used ``python=3.9`` as default for creating the conda environment. We recommend changing it to ``3.11``, using below command:
- The Text Generation WebUI API service requires Python version 3.10 or higher. But [IPEX-LLM installation instructions](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/webui_quickstart.html#install-ipex-llm) used ``python=3.11`` as default for creating the conda environment. We recommend changing it to ``3.11``, using below command:
```bash
conda create -n llm python=3.11 libuv
```

View file

@ -144,7 +144,7 @@ You can use `conda --version` to verify you conda installation.
After installation, create a new python environment `llm`:
```cmd
conda create -n llm python=3.9
conda create -n llm python=3.11
```
Activate the newly created environment `llm`:
```cmd

View file

@ -57,7 +57,7 @@ Visit [Miniconda installation page](https://docs.anaconda.com/free/miniconda/),
Open the **Anaconda Prompt**. Then create a new python environment `llm` and activate it:
```cmd
conda create -n llm python=3.9 libuv
conda create -n llm python=3.11 libuv
conda activate llm
```

View file

@ -26,7 +26,7 @@ Visit the [Install IPEX-LLM on Windows with Intel GPU Guide](https://ipex-llm.re
To use `llama.cpp` with IPEX-LLM, first ensure that `ipex-llm[cpp]` is installed.
```cmd
conda create -n llm-cpp python=3.9
conda create -n llm-cpp python=3.11
conda activate llm-cpp
pip install --pre --upgrade ipex-llm[cpp]
```

View file

@ -11,7 +11,7 @@ mkdir autogen
cd autogen
# create respective conda environment
conda create -n autogen python=3.9
conda create -n autogen python=3.11
conda activate autogen
# install fastchat-adapted ipex-llm

View file

@ -10,7 +10,7 @@ To run this example with IPEX-LLM, we have some recommended requirements for you
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -10,7 +10,7 @@ model = AutoModelForCausalLM.from_pretrained(model_name_or_path, load_in_4bit=Tr
## Prepare Environment
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all]

View file

@ -2,7 +2,7 @@
#### 1. Install Dependencies
Install necessary packages (here Python 3.9 is our test environment):
Install necessary packages (here Python 3.11 is our test environment):
```bash
bash install.sh

View file

@ -34,7 +34,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a AWQ
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install autoawq==0.1.8 --no-deps

View file

@ -25,7 +25,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Llam
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Baic
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Baic
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Blue
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Chat
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option
@ -80,7 +80,7 @@ In the example [streamchat.py](./streamchat.py), we show a basic use case for a
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Chat
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option
@ -81,7 +81,7 @@ In the example [streamchat.py](./streamchat.py), we show a basic use case for a
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Code
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Deci
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Deep
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Doll
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Doll
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Falc
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -14,7 +14,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default
@ -27,7 +27,7 @@ pip install transformers==4.38.1
#### 1.2 Installation on Windows
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9 libuv
conda create -n llm python=3.11 libuv
conda activate llm
# below command will install intel_extension_for_pytorch==2.1.10+xpu as default
pip install --pre --upgrade ipex-llm[xpu] --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Inte
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Inte
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Llam
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
# below command will install PyTorch CPU as default

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a MOSS
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for an MPT
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Phoe
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -15,7 +15,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Qwen
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Qwen
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a RedP
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Skyw
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a SOLA
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for an Sta
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Vicu
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -10,7 +10,7 @@ In the example [recognize.py](./recognize.py), we show a basic use case for a Wh
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option
@ -66,7 +66,7 @@ In the example [long-segment-recognize.py](./long-segment-recognize.py), we show
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -9,7 +9,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Wiza
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -16,7 +16,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -5,7 +5,7 @@ In this example, we show a pipeline to apply IPEX-LLM low-bit optimizations (inc
## Prepare Environment
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all]

View file

@ -5,7 +5,7 @@ In this example, we show a pipeline to apply IPEX-LLM low-bit optimizations (inc
## Prepare Environment
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all]

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case for a Chat
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -7,7 +7,7 @@ In this example, we show a pipeline to convert a large language model to IPEX-LL
## Prepare Environment
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all]

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -10,7 +10,7 @@ In the example [example_chat_completion.py](./example_chat_completion.py), we sh
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
# Install meta-llama repository

View file

@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
# below command will install PyTorch CPU as default

View file

@ -10,7 +10,7 @@ In the example [recognize.py](./recognize.py), we show a basic use case for a Wh
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install ipex-llm[all] # install ipex-llm with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -12,7 +12,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -13,7 +13,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -11,7 +11,7 @@ We suggest using conda to manage the Python environment. For more information ab
After installing conda, create a Python environment for IPEX-LLM:
```bash
conda create -n llm python=3.9 # recommend to use Python 3.9
conda create -n llm python=3.11 # recommend to use Python 3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install the latest ipex-llm nightly build with 'all' option

View file

@ -10,7 +10,7 @@ In the example [generate.py](./generate.py), we show a basic use case of low-bit
### 1. Install
We suggest using conda to manage environment:
```bash
conda create -n llm python=3.9
conda create -n llm python=3.11
conda activate llm
pip install --pre --upgrade ipex-llm[all] # install ipex-llm with 'all' option

Some files were not shown because too many files have changed in this diff Show more