ipex-llm/python/llm/dev/benchmark/all-in-one/README.md
2023-09-01 10:48:00 +08:00

17 lines
No EOL
546 B
Markdown

# All in One Benchmark Test
All in one benchmark test allows users to test all the benchmarks and record them in a result CSV. Users can provide models and related information in `config.yaml`.
Before running, make sure to have [bigdl-llm](../../../README.md) installed.
## Config
Config YAML file has following format
```yaml
model_name: model_path
# following is an example, with model name llama2
llama2: /path/to/llama2
```
## Run
run `python run.py`, this will output results to `results.csv`.
For SPR performance, run `bash run-spr.sh`.