Update gpu configuration (#10760)
This commit is contained in:
parent
b5209d3ec1
commit
486df2764a
2 changed files with 15 additions and 6 deletions
|
|
@ -135,15 +135,11 @@ Please also set the following environment variable if you would like to run LLMs
|
||||||
set SYCL_CACHE_PERSISTENT=1
|
set SYCL_CACHE_PERSISTENT=1
|
||||||
set BIGDL_LLM_XMX_DISABLED=1
|
set BIGDL_LLM_XMX_DISABLED=1
|
||||||
|
|
||||||
.. tab:: Intel Arc™ A300-Series or Pro A60
|
.. tab:: Intel Arc™ A-Series
|
||||||
|
|
||||||
.. code-block:: cmd
|
.. code-block:: cmd
|
||||||
|
|
||||||
set SYCL_CACHE_PERSISTENT=1
|
set SYCL_CACHE_PERSISTENT=1
|
||||||
|
|
||||||
.. tab:: Other Intel dGPU Series
|
|
||||||
|
|
||||||
There is no need to set further environment variables.
|
|
||||||
```
|
```
|
||||||
|
|
||||||
```eval_rst
|
```eval_rst
|
||||||
|
|
@ -572,6 +568,17 @@ To use GPU acceleration on Linux, several environment variables are required or
|
||||||
|
|
||||||
Please note that ``libtcmalloc.so`` can be installed by ``conda install -c conda-forge -y gperftools=2.10``
|
Please note that ``libtcmalloc.so`` can be installed by ``conda install -c conda-forge -y gperftools=2.10``
|
||||||
|
|
||||||
|
.. tab:: Intel iGPU
|
||||||
|
|
||||||
|
.. code-block:: bash
|
||||||
|
|
||||||
|
# Configure oneAPI environment variables. Required step for APT or offline installed oneAPI.
|
||||||
|
# Skip this step for PIP-installed oneAPI since the environment has already been configured in LD_LIBRARY_PATH.
|
||||||
|
source /opt/intel/oneapi/setvars.sh
|
||||||
|
|
||||||
|
export SYCL_CACHE_PERSISTENT=1
|
||||||
|
export BIGDL_LLM_XMX_DISABLED=1
|
||||||
|
|
||||||
```
|
```
|
||||||
|
|
||||||
### Known issues
|
### Known issues
|
||||||
|
|
|
||||||
|
|
@ -117,7 +117,9 @@ You can verify if `ipex-llm` is successfully installed following below steps.
|
||||||
|
|
||||||
.. tab:: Intel Arc™ A770
|
.. tab:: Intel Arc™ A770
|
||||||
|
|
||||||
There is no need to set further environment variables.
|
.. code-block:: cmd
|
||||||
|
|
||||||
|
set SYCL_CACHE_PERSISTENT=1
|
||||||
```
|
```
|
||||||
|
|
||||||
```eval_rst
|
```eval_rst
|
||||||
|
|
|
||||||
Loading…
Reference in a new issue