Update gpu configuration (#10760)

This commit is contained in:
Yuwen Hu 2024-04-15 13:27:15 +08:00 committed by GitHub
parent b5209d3ec1
commit 486df2764a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 15 additions and 6 deletions

View file

@ -135,15 +135,11 @@ Please also set the following environment variable if you would like to run LLMs
set SYCL_CACHE_PERSISTENT=1
set BIGDL_LLM_XMX_DISABLED=1
.. tab:: Intel Arc™ A300-Series or Pro A60
.. tab:: Intel Arc™ A-Series
.. code-block:: cmd
set SYCL_CACHE_PERSISTENT=1
.. tab:: Other Intel dGPU Series
There is no need to set further environment variables.
```
```eval_rst
@ -572,6 +568,17 @@ To use GPU acceleration on Linux, several environment variables are required or
Please note that ``libtcmalloc.so`` can be installed by ``conda install -c conda-forge -y gperftools=2.10``
.. tab:: Intel iGPU
.. code-block:: bash
# Configure oneAPI environment variables. Required step for APT or offline installed oneAPI.
# Skip this step for PIP-installed oneAPI since the environment has already been configured in LD_LIBRARY_PATH.
source /opt/intel/oneapi/setvars.sh
export SYCL_CACHE_PERSISTENT=1
export BIGDL_LLM_XMX_DISABLED=1
```
### Known issues

View file

@ -117,7 +117,9 @@ You can verify if `ipex-llm` is successfully installed following below steps.
.. tab:: Intel Arc™ A770
There is no need to set further environment variables.
.. code-block:: cmd
set SYCL_CACHE_PERSISTENT=1
```
```eval_rst