ipex-llm/python/llm/dev/benchmark/all-in-one/config.yaml
Xin Qiu 5d9942a3ca transformer int4 and native int4's benchmark script for 32 256 1k 2k input (#8871)
* transformer

* move

* update

* add header

* update all-in-one

* clean up
2023-09-07 09:49:55 +08:00

6 lines
142 B
YAML

repo_id:
- 'THUDM/chatglm2-6b'
- 'meta-llama/Llama-2-7b-chat-hf'
local_model_hub: 'path to your local model hub'
warm_up: 1
num_trials: 3