ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Add yuan2-2b to win igpu perf test (#10250)

Browse source
This commit is contained in:
Yuwen Hu 2024-02-27 11:08:33 +08:00 committed by GitHub
parent 36a9e88104
commit 38ae4b372f
4 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
python/llm/test/benchmark/igpu-perf/1024-128.yaml
View file

@ -15,6 +15,7 @@ repo_id:
- 'liuhaotian/llava-v1.5-7b' - 'liuhaotian/llava-v1.5-7b'
- 'RWKV/rwkv-4-world-7b' - 'RWKV/rwkv-4-world-7b'
- 'RWKV/rwkv-5-world-7b' - 'RWKV/rwkv-5-world-7b'
- 'IEITYuan/Yuan2-2B-hf'
local_model_hub: 'path to your local model hub' local_model_hub: 'path to your local model hub'
warm_up: 1 warm_up: 1
num_trials: 3 num_trials: 3

1
python/llm/test/benchmark/igpu-perf/2048-256.yaml
View file

@ -14,6 +14,7 @@ repo_id:
- 'liuhaotian/llava-v1.5-7b' - 'liuhaotian/llava-v1.5-7b'
- 'RWKV/rwkv-4-world-7b' - 'RWKV/rwkv-4-world-7b'
- 'RWKV/rwkv-5-world-7b' - 'RWKV/rwkv-5-world-7b'
- 'IEITYuan/Yuan2-2B-hf'
local_model_hub: 'path to your local model hub' local_model_hub: 'path to your local model hub'
warm_up: 1 warm_up: 1
num_trials: 3 num_trials: 3

1
python/llm/test/benchmark/igpu-perf/32-32.yaml
View file

@ -15,6 +15,7 @@ repo_id:
- 'liuhaotian/llava-v1.5-7b' - 'liuhaotian/llava-v1.5-7b'
- 'RWKV/rwkv-4-world-7b' - 'RWKV/rwkv-4-world-7b'
- 'RWKV/rwkv-5-world-7b' - 'RWKV/rwkv-5-world-7b'
- 'IEITYuan/Yuan2-2B-hf'
local_model_hub: 'path to your local model hub' local_model_hub: 'path to your local model hub'
warm_up: 3 warm_up: 3
num_trials: 5 num_trials: 5

1
python/llm/test/benchmark/igpu-perf/32-512.yaml
View file

@ -15,6 +15,7 @@ repo_id:
- 'liuhaotian/llava-v1.5-7b' - 'liuhaotian/llava-v1.5-7b'
- 'RWKV/rwkv-4-world-7b' - 'RWKV/rwkv-4-world-7b'
- 'RWKV/rwkv-5-world-7b' - 'RWKV/rwkv-5-world-7b'
- 'IEITYuan/Yuan2-2B-hf'
local_model_hub: 'path to your local model hub' local_model_hub: 'path to your local model hub'
warm_up: 1 warm_up: 1
num_trials: 3 num_trials: 3