From 486df2764ad5073052891a46a33475e5893e6d5e Mon Sep 17 00:00:00 2001 From: Yuwen Hu <54161268+Oscilloscope98@users.noreply.github.com> Date: Mon, 15 Apr 2024 13:27:15 +0800 Subject: [PATCH] Update gpu configuration (#10760) --- .../source/doc/LLM/Overview/install_gpu.md | 17 ++++++++++++----- .../doc/LLM/Quickstart/install_windows_gpu.md | 4 +++- 2 files changed, 15 insertions(+), 6 deletions(-) diff --git a/docs/readthedocs/source/doc/LLM/Overview/install_gpu.md b/docs/readthedocs/source/doc/LLM/Overview/install_gpu.md index b58e6f1e..563402b6 100644 --- a/docs/readthedocs/source/doc/LLM/Overview/install_gpu.md +++ b/docs/readthedocs/source/doc/LLM/Overview/install_gpu.md @@ -135,15 +135,11 @@ Please also set the following environment variable if you would like to run LLMs set SYCL_CACHE_PERSISTENT=1 set BIGDL_LLM_XMX_DISABLED=1 - .. tab:: Intel Arc™ A300-Series or Pro A60 + .. tab:: Intel Arc™ A-Series .. code-block:: cmd set SYCL_CACHE_PERSISTENT=1 - - .. tab:: Other Intel dGPU Series - - There is no need to set further environment variables. ``` ```eval_rst @@ -572,6 +568,17 @@ To use GPU acceleration on Linux, several environment variables are required or Please note that ``libtcmalloc.so`` can be installed by ``conda install -c conda-forge -y gperftools=2.10`` + .. tab:: Intel iGPU + + .. code-block:: bash + + # Configure oneAPI environment variables. Required step for APT or offline installed oneAPI. + # Skip this step for PIP-installed oneAPI since the environment has already been configured in LD_LIBRARY_PATH. + source /opt/intel/oneapi/setvars.sh + + export SYCL_CACHE_PERSISTENT=1 + export BIGDL_LLM_XMX_DISABLED=1 + ``` ### Known issues diff --git a/docs/readthedocs/source/doc/LLM/Quickstart/install_windows_gpu.md b/docs/readthedocs/source/doc/LLM/Quickstart/install_windows_gpu.md index 6a0c2e78..2d930ca3 100644 --- a/docs/readthedocs/source/doc/LLM/Quickstart/install_windows_gpu.md +++ b/docs/readthedocs/source/doc/LLM/Quickstart/install_windows_gpu.md @@ -117,7 +117,9 @@ You can verify if `ipex-llm` is successfully installed following below steps. .. tab:: Intel Arc™ A770 - There is no need to set further environment variables. + .. code-block:: cmd + + set SYCL_CACHE_PERSISTENT=1 ``` ```eval_rst