ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

LLM: update perf test configuration (#9264)

Browse source
This commit is contained in:
binbin Deng 2023-10-25 12:35:48 +08:00 committed by GitHub
parent 770ac70b00
commit f597a9d4f5
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
python/llm/test/benchmark/arc-perf-test.yaml
View file

@ -8,6 +8,7 @@ local_model_hub: '/mnt/disk1/models'
warm_up: 1 warm_up: 1
num_trials: 3 num_trials: 3
num_beams: 1 # default to greedy search num_beams: 1 # default to greedy search
low_bit: 'sym_int4' # default to use 'sym_int4' (i.e. symmetric int4)
in_out_pairs: in_out_pairs:
- '32-32' - '32-32'
- '1024-128' - '1024-128'