Update gpu configuration (#10760)
This commit is contained in:
parent
b5209d3ec1
commit
486df2764a
2 changed files with 15 additions and 6 deletions
|
|
@ -135,15 +135,11 @@ Please also set the following environment variable if you would like to run LLMs
|
|||
set SYCL_CACHE_PERSISTENT=1
|
||||
set BIGDL_LLM_XMX_DISABLED=1
|
||||
|
||||
.. tab:: Intel Arc™ A300-Series or Pro A60
|
||||
.. tab:: Intel Arc™ A-Series
|
||||
|
||||
.. code-block:: cmd
|
||||
|
||||
set SYCL_CACHE_PERSISTENT=1
|
||||
|
||||
.. tab:: Other Intel dGPU Series
|
||||
|
||||
There is no need to set further environment variables.
|
||||
```
|
||||
|
||||
```eval_rst
|
||||
|
|
@ -572,6 +568,17 @@ To use GPU acceleration on Linux, several environment variables are required or
|
|||
|
||||
Please note that ``libtcmalloc.so`` can be installed by ``conda install -c conda-forge -y gperftools=2.10``
|
||||
|
||||
.. tab:: Intel iGPU
|
||||
|
||||
.. code-block:: bash
|
||||
|
||||
# Configure oneAPI environment variables. Required step for APT or offline installed oneAPI.
|
||||
# Skip this step for PIP-installed oneAPI since the environment has already been configured in LD_LIBRARY_PATH.
|
||||
source /opt/intel/oneapi/setvars.sh
|
||||
|
||||
export SYCL_CACHE_PERSISTENT=1
|
||||
export BIGDL_LLM_XMX_DISABLED=1
|
||||
|
||||
```
|
||||
|
||||
### Known issues
|
||||
|
|
|
|||
|
|
@ -117,7 +117,9 @@ You can verify if `ipex-llm` is successfully installed following below steps.
|
|||
|
||||
.. tab:: Intel Arc™ A770
|
||||
|
||||
There is no need to set further environment variables.
|
||||
.. code-block:: cmd
|
||||
|
||||
set SYCL_CACHE_PERSISTENT=1
|
||||
```
|
||||
|
||||
```eval_rst
|
||||
|
|
|
|||
Loading…
Reference in a new issue