From 3e39828420d1928cd4e439825600212703f955fe Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Cheen=20Hau=2C=20=E4=BF=8A=E8=B1=AA?= <33478814+chtanch@users.noreply.github.com> Date: Tue, 21 Nov 2023 14:57:16 +0800 Subject: [PATCH] Update all in one benchmark readme (#9496) * Add gperftools install to all in one benchmark readme * Update readme --- python/llm/dev/benchmark/all-in-one/README.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/python/llm/dev/benchmark/all-in-one/README.md b/python/llm/dev/benchmark/all-in-one/README.md index 34604257..06d0b5c3 100644 --- a/python/llm/dev/benchmark/all-in-one/README.md +++ b/python/llm/dev/benchmark/all-in-one/README.md @@ -9,6 +9,11 @@ pip install omegaconf pip install pandas ``` +Install gperftools to use libtcmalloc.so for MAX GPU to get better performance: +```bash +conda install -c conda-forge -y gperftools=2.10 +``` + ## Config Config YAML file has following format ```yaml @@ -46,3 +51,5 @@ For SPR performance, run `bash run-spr.sh`. > Please install torch nightly version to avoid `Illegal instruction (core dumped)` issue, you can follow the following command to install: `pip install --pre --upgrade torch --index-url https://download.pytorch.org/whl/nightly/cpu` For ARC performance, run `bash run-arc.sh`. + +For MAX GPU performance, run `bash run-max-gpu.sh`. \ No newline at end of file