ipex-llm/python/llm/test/benchmark
Yuwen Hu 8982ab73d5
Add Yi-6B and StableLM to iGPU perf test (#11546)
* Add transformer4.38.2 test to igpu benchmark (#11529)

* add transformer4.38.1 test to igpu benchmark

* use transformers4.38.2 & fix csv name error in 4.38 workflow

* add model Yi-6B-Chat & remove temporarily most models

---------

Co-authored-by: ATMxsp01 <shou.xu@intel.com>

* filter some errorlevel (#11541)

Co-authored-by: ATMxsp01 <shou.xu@intel.com>

* Restore the temporarily removed models in iGPU-perf (#11544)

* filter some errorlevel

* restore the temporarily removed models in iGPU-perf

---------

Co-authored-by: ATMxsp01 <shou.xu@intel.com>

---------

Co-authored-by: Xu, Shuo <100334393+ATMxsp01@users.noreply.github.com>
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
2024-07-09 18:51:23 +08:00
..
ceval Fix C-Eval Workflow (#10359) 2024-03-13 17:23:17 +08:00
harness Move harness nightly related files to llm/test folder (#10209) 2024-02-23 11:12:36 +08:00
igpu-perf Add Yi-6B and StableLM to iGPU perf test (#11546) 2024-07-09 18:51:23 +08:00
perplexity edit 'ppl_result does not exist' issue, delete useless code (#10767) 2024-04-16 18:11:56 +08:00
arc-perf-test-batch2.yaml Add new models to benchmark (#11505) 2024-07-08 10:35:55 +08:00
arc-perf-test-batch4.yaml Add new models to benchmark (#11505) 2024-07-08 10:35:55 +08:00
arc-perf-test.yaml Add new models to benchmark (#11505) 2024-07-08 10:35:55 +08:00
arc-perf-transformers-437-batch2.yaml Add new models to benchmark (#11505) 2024-07-08 10:35:55 +08:00
arc-perf-transformers-437-batch4.yaml Add new models to benchmark (#11505) 2024-07-08 10:35:55 +08:00
arc-perf-transformers-437.yaml Add new models to benchmark (#11505) 2024-07-08 10:35:55 +08:00
arc-perf-transformers-440.yaml Add qwen-moe batch1 to nightly perf (#11369) 2024-06-20 14:17:41 +08:00
check_results.py Modify the check_results.py to support batch 2&4 (#11133) 2024-06-05 15:04:55 +08:00
concat_csv.py [LLM] Add qwen1.5-7B in iGPU perf (#10127) 2024-02-07 22:31:20 +08:00
core-perf-test.yaml Update igpu perf internlm (#10958) 2024-05-08 14:16:43 +08:00
cpu-perf-test.yaml update spr perf test (#10644) 2024-04-03 15:53:55 +08:00
csv_to_html.py Modify the check_results.py to support batch 2&4 (#11133) 2024-06-05 15:04:55 +08:00
merge_csv_batch.py Merge multiple batches (#11264) 2024-06-07 18:38:45 +08:00
stable-version-arc-perf-test-fp8.yaml Arc Stable version test (#10087) 2024-02-06 10:23:50 +08:00
stable-version-arc-perf-test-sym_int4.yaml Arc Stable version test (#10087) 2024-02-06 10:23:50 +08:00
stable-version-arc-stress-test-fp8.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
stable-version-arc-stress-test-sym_int4.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
stable-version-cpu-perf-test.yaml Update tests for transformers 4.36 (#10858) 2024-05-24 10:26:38 +08:00
stable-version-cpu-stress-test.yaml Update tests for transformers 4.36 (#10858) 2024-05-24 10:26:38 +08:00
update_html_in_parent_folder.py Add batch 4 perf test (#11355) 2024-06-20 09:48:52 +08:00