ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update linux igpu run script (#11098)

Browse source 
* update run script
This commit is contained in:
Zhao Changmin 2024-05-22 17:18:07 +08:00 committed by GitHub
parent f63172ef63
commit 15d906a97b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 14 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
docs/readthedocs/source/doc/LLM/Quickstart/benchmark_quickstart.md
View file

@ -113,6 +113,14 @@ Please refer to [here](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Overvie
./run-arc.sh ./run-arc.sh
.. tab:: Intel iGPU
For Intel iGPU, we recommend:
.. code-block:: bash
./run-igpu.sh
.. tab:: Intel Data Center GPU Max .. tab:: Intel Data Center GPU Max
Please note that you need to run ``conda install -c conda-forge -y gperftools=2.10`` before running the benchmark script on Intel Data Center GPU Max Series. Please note that you need to run ``conda install -c conda-forge -y gperftools=2.10`` before running the benchmark script on Intel Data Center GPU Max Series.

6
python/llm/dev/benchmark/all-in-one/run-igpu.sh Normal file
View file

@ -0,0 +1,6 @@
source /opt/intel/oneapi/setvars.sh
export SYCL_CACHE_PERSISTENT=1
export BIGDL_LLM_XMX_DISABLED=1
python run.py # make sure config YAML file