ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/test/benchmark/igpu-perf
History
Yuwen Hu ec184af243
Add gemma-2-2b-it and gemma-2-9b-it to igpu nightly performance test (#11778) 
* add yaml and modify `concat_csv.py` for `transformers` 4.43.1 (#11758)

* add yaml and modify `concat_csv.py` for `transformers` 4.43.1

* remove 4.43 for arc; fix;

* remove 4096-512 for 4.43

* comment some models

* Small fix

* uncomment models (#11777)

---------

Co-authored-by: Ch1y0q <qiyue2001@gmail.com>
2024-08-13 15:39:56 +08:00
..
32-32_int4_fp16.yaml Test MiniCPM performance on iGPU in a more stable way (#11573) 2024-07-12 17:07:41 +08:00
32-32_int4_fp16_437.yaml Add qwen2-1.5b-instruct into igpu performance (#11735) 2024-08-08 16:42:18 +08:00
32-32_int4_fp16_438.yaml Add Yi-6B and StableLM to iGPU perf test (#11546) 2024-07-09 18:51:23 +08:00
32-32_int4_fp16_443.yaml Add gemma-2-2b-it and gemma-2-9b-it to igpu nightly performance test (#11778) 2024-08-13 15:39:56 +08:00
1024-128.yaml Test MiniCPM performance on iGPU in a more stable way (#11573) 2024-07-12 17:07:41 +08:00
1024-128_437.yaml Add qwen2-1.5b-instruct into igpu performance (#11735) 2024-08-08 16:42:18 +08:00
1024-128_438.yaml Add Yi-6B and StableLM to iGPU perf test (#11546) 2024-07-09 18:51:23 +08:00
1024-128_443.yaml Add gemma-2-2b-it and gemma-2-9b-it to igpu nightly performance test (#11778) 2024-08-13 15:39:56 +08:00
1024-128_int4_fp16.yaml Test MiniCPM performance on iGPU in a more stable way (#11573) 2024-07-12 17:07:41 +08:00
1024-128_int4_fp16_437.yaml Add qwen2-1.5b-instruct into igpu performance (#11735) 2024-08-08 16:42:18 +08:00
1024-128_int4_fp16_438.yaml Add Yi-6B and StableLM to iGPU perf test (#11546) 2024-07-09 18:51:23 +08:00
1024-128_int4_fp16_443.yaml Add gemma-2-2b-it and gemma-2-9b-it to igpu nightly performance test (#11778) 2024-08-13 15:39:56 +08:00
1024-128_int4_fp16_loadlowbit.yaml Test MiniCPM performance on iGPU in a more stable way (#11573) 2024-07-12 17:07:41 +08:00
1024-128_int4_fp16_loadlowbit_437.yaml Add qwen2-1.5b-instruct into igpu performance (#11735) 2024-08-08 16:42:18 +08:00
1024-128_int4_fp16_loadlowbit_438.yaml Add Yi-6B and StableLM to iGPU perf test (#11546) 2024-07-09 18:51:23 +08:00
1024-128_int4_fp16_loadlowbit_443.yaml Add gemma-2-2b-it and gemma-2-9b-it to igpu nightly performance test (#11778) 2024-08-13 15:39:56 +08:00
2048-256_int4_fp16.yaml Test MiniCPM performance on iGPU in a more stable way (#11573) 2024-07-12 17:07:41 +08:00
2048-256_int4_fp16_437.yaml Add qwen2-1.5b-instruct into igpu performance (#11735) 2024-08-08 16:42:18 +08:00
2048-256_int4_fp16_438.yaml Add Yi-6B and StableLM to iGPU perf test (#11546) 2024-07-09 18:51:23 +08:00
2048-256_int4_fp16_443.yaml Add gemma-2-2b-it and gemma-2-9b-it to igpu nightly performance test (#11778) 2024-08-13 15:39:56 +08:00
3072-384_int4_fp16.yaml add 3k and 4k input of nightly perf test on iGPU (#11701) 2024-08-01 14:17:46 +08:00
3072-384_int4_fp16_437.yaml Add qwen2-1.5b-instruct into igpu performance (#11735) 2024-08-08 16:42:18 +08:00
3072-384_int4_fp16_438.yaml add 3k and 4k input of nightly perf test on iGPU (#11701) 2024-08-01 14:17:46 +08:00
3072-384_int4_fp16_443.yaml Add gemma-2-2b-it and gemma-2-9b-it to igpu nightly performance test (#11778) 2024-08-13 15:39:56 +08:00
4096-512_int4_fp16.yaml add 3k and 4k input of nightly perf test on iGPU (#11701) 2024-08-01 14:17:46 +08:00
4096-512_int4_fp16_437.yaml Add qwen2-1.5b-instruct into igpu performance (#11735) 2024-08-08 16:42:18 +08:00
4096-512_int4_fp16_438.yaml add 3k and 4k input of nightly perf test on iGPU (#11701) 2024-08-01 14:17:46 +08:00
4096-512_int4_fp16_443.yaml Add gemma-2-2b-it and gemma-2-9b-it to igpu nightly performance test (#11778) 2024-08-13 15:39:56 +08:00
check_csv_results.py Add check in iGPU perf workflow for results integrity (#11616) 2024-07-18 14:13:16 +08:00