ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Add qwen2-1.5b-instruct into igpu performance (#11735)

Browse source 
* updated qwen1.5B to all transformer==4.37 yaml

* updated qwen1.5B to all transformer==4.37 yaml
This commit is contained in:
Jinhe 2024-08-08 16:42:18 +08:00 committed by GitHub
parent 107f7aafd0
commit 27b4b104ed
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
7 changed files with 7 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
python/llm/test/benchmark/igpu-perf/1024-128_437.yaml
View file

@ -1,5 +1,6 @@
repo_id: repo_id:
- 'Qwen/Qwen1.5-7B-Chat' - 'Qwen/Qwen1.5-7B-Chat'
- 'Qwen/Qwen2-1.5B-Instruct'
- 'Qwen/Qwen2-7B-Instruct' - 'Qwen/Qwen2-7B-Instruct'
- 'microsoft/Phi-3-mini-4k-instruct' - 'microsoft/Phi-3-mini-4k-instruct'
- 'microsoft/Phi-3-mini-128k-instruct' - 'microsoft/Phi-3-mini-128k-instruct'

1
python/llm/test/benchmark/igpu-perf/1024-128_int4_fp16_437.yaml
View file

@ -1,5 +1,6 @@
repo_id: repo_id:
- 'Qwen/Qwen1.5-7B-Chat' - 'Qwen/Qwen1.5-7B-Chat'
- 'Qwen/Qwen2-1.5B-Instruct'
- 'Qwen/Qwen2-7B-Instruct' - 'Qwen/Qwen2-7B-Instruct'
- 'microsoft/Phi-3-mini-4k-instruct' - 'microsoft/Phi-3-mini-4k-instruct'
- 'microsoft/Phi-3-mini-128k-instruct' - 'microsoft/Phi-3-mini-128k-instruct'

1
python/llm/test/benchmark/igpu-perf/1024-128_int4_fp16_loadlowbit_437.yaml
View file

@ -1,5 +1,6 @@
repo_id: repo_id:
- 'Qwen/Qwen1.5-7B-Chat' - 'Qwen/Qwen1.5-7B-Chat'
- 'Qwen/Qwen2-1.5B-Instruct'
- 'Qwen/Qwen2-7B-Instruct' - 'Qwen/Qwen2-7B-Instruct'
- 'microsoft/Phi-3-mini-4k-instruct' - 'microsoft/Phi-3-mini-4k-instruct'
- 'microsoft/Phi-3-mini-128k-instruct' - 'microsoft/Phi-3-mini-128k-instruct'

1
python/llm/test/benchmark/igpu-perf/2048-256_int4_fp16_437.yaml
View file

@ -1,5 +1,6 @@
repo_id: repo_id:
- 'Qwen/Qwen1.5-7B-Chat' - 'Qwen/Qwen1.5-7B-Chat'
- 'Qwen/Qwen2-1.5B-Instruct'
- 'Qwen/Qwen2-7B-Instruct' - 'Qwen/Qwen2-7B-Instruct'
- 'microsoft/Phi-3-mini-4k-instruct' - 'microsoft/Phi-3-mini-4k-instruct'
- 'microsoft/Phi-3-mini-128k-instruct' - 'microsoft/Phi-3-mini-128k-instruct'

1
python/llm/test/benchmark/igpu-perf/3072-384_int4_fp16_437.yaml
View file

@ -1,5 +1,6 @@
repo_id: repo_id:
- 'Qwen/Qwen1.5-7B-Chat' - 'Qwen/Qwen1.5-7B-Chat'
- 'Qwen/Qwen2-1.5B-Instruct'
- 'Qwen/Qwen2-7B-Instruct' - 'Qwen/Qwen2-7B-Instruct'
- 'microsoft/Phi-3-mini-4k-instruct' - 'microsoft/Phi-3-mini-4k-instruct'
- 'microsoft/Phi-3-mini-128k-instruct' - 'microsoft/Phi-3-mini-128k-instruct'

1
python/llm/test/benchmark/igpu-perf/32-32_int4_fp16_437.yaml
View file

@ -1,5 +1,6 @@
repo_id: repo_id:
- 'Qwen/Qwen1.5-7B-Chat' - 'Qwen/Qwen1.5-7B-Chat'
- 'Qwen/Qwen2-1.5B-Instruct'
- 'Qwen/Qwen2-7B-Instruct' - 'Qwen/Qwen2-7B-Instruct'
- 'microsoft/Phi-3-mini-4k-instruct' - 'microsoft/Phi-3-mini-4k-instruct'
- 'microsoft/Phi-3-mini-128k-instruct' - 'microsoft/Phi-3-mini-128k-instruct'

1
python/llm/test/benchmark/igpu-perf/4096-512_int4_fp16_437.yaml
View file

@ -1,5 +1,6 @@
repo_id: repo_id:
- 'Qwen/Qwen1.5-7B-Chat' - 'Qwen/Qwen1.5-7B-Chat'
- 'Qwen/Qwen2-1.5B-Instruct'
- 'Qwen/Qwen2-7B-Instruct' - 'Qwen/Qwen2-7B-Instruct'
- 'microsoft/Phi-3-mini-4k-instruct' - 'microsoft/Phi-3-mini-4k-instruct'
- 'microsoft/Phi-3-mini-128k-instruct' - 'microsoft/Phi-3-mini-128k-instruct'