ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/dev/benchmark/all-in-one
History
Song Jiaming 7b3ac66e17 [LLM] auto performance test fix specific settings to template (#8876)
2023-09-01 15:49:04 +08:00
..
config.yaml [LLM] auto performance test fix specific settings to template (#8876) 2023-09-01 15:49:04 +08:00
README.md [LLM] auto perf test to output to csv (#8846) 2023-09-01 10:48:00 +08:00
run-spr.sh [LLM] auto perf test to output to csv (#8846) 2023-09-01 10:48:00 +08:00
run.py [LLM] auto perf test to output to csv (#8846) 2023-09-01 10:48:00 +08:00

README.md

All in One Benchmark Test

All in one benchmark test allows users to test all the benchmarks and record them in a result CSV. Users can provide models and related information in config.yaml.

Before running, make sure to have bigdl-llm installed.

Config

Config YAML file has following format

model_name: model_path
# following is an example, with model name llama2
llama2: /path/to/llama2

Run

run python run.py, this will output results to results.csv.

For SPR performance, run bash run-spr.sh.