ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update all in one benchmark readme (#9496)

Browse source 
* Add gperftools install to all in one benchmark readme

* Update readme
This commit is contained in:
Cheen Hau, 俊豪 2023-11-21 14:57:16 +08:00 committed by GitHub
parent 2b200bf2f2
commit 3e39828420
1 changed files with 7 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
python/llm/dev/benchmark/all-in-one/README.md
View file

@ -9,6 +9,11 @@ pip install omegaconf
pip install pandas
```
Install gperftools to use libtcmalloc.so for MAX GPU to get better performance:
```bash
conda install -c conda-forge -y gperftools=2.10
```
## Config
Config YAML file has following format
```yaml
@ -46,3 +51,5 @@ For SPR performance, run `bash run-spr.sh`.
> Please install torch nightly version to avoid `Illegal instruction (core dumped)` issue, you can follow the following command to install: `pip install --pre --upgrade torch --index-url https://download.pytorch.org/whl/nightly/cpu`
For ARC performance, run `bash run-arc.sh`.
For MAX GPU performance, run `bash run-max-gpu.sh`.