ipex-llm/python/llm/test/benchmark
Wenjing Margaret Mao 231b968aba
Modify the check_results.py to support batch 2&4 (#11133)
* add batch 2&4 and exclude to perf_test

* modify the perf-test&437 yaml

* modify llm_performance_test.yml

* remove batch 4

* modify check_results.py to support batch 2&4

* change the batch_size format

* remove genxir

* add str(batch_size)

* change actual_test_casese in check_results file to support batch_size

* change html highlight

* less models to test html and html_path

* delete the moe model

* split batch html

* split

* use installing from pypi

* use installing from pypi - batch2

* revert cpp

* revert cpp

* merge two jobs into one, test batch_size in one job

* merge two jobs into one, test batch_size in one job

* change file directory in workflow

* try catch deal with odd file without batch_size

* modify pandas version

* change the dir

* organize the code

* organize the code

* remove Qwen-MOE

* modify based on feedback

* modify based on feedback

* modify based on second round of feedback

* modify based on second round of feedback + change run-arc.sh mode

* modify based on second round of feedback + revert config

* modify based on second round of feedback + revert config

* modify based on second round of feedback + remove comments

* modify based on second round of feedback + remove comments

* modify based on second round of feedback + revert arc-perf-test

* modify based on third round of feedback

* change error type

* change error type

* modify check_results.html

* split batch into two folders

* add all models

* move csv_name

* revert pr test

* revert pr test

---------

Co-authored-by: Yishuo Wang <yishuo.wang@intel.com>
2024-06-05 15:04:55 +08:00
..
ceval Fix C-Eval Workflow (#10359) 2024-03-13 17:23:17 +08:00
harness Move harness nightly related files to llm/test folder (#10209) 2024-02-23 11:12:36 +08:00
igpu-perf Update tests for transformers 4.36 (#10858) 2024-05-24 10:26:38 +08:00
perplexity edit 'ppl_result does not exist' issue, delete useless code (#10767) 2024-04-16 18:11:56 +08:00
arc-perf-test-batch2.yaml Modify the check_results.py to support batch 2&4 (#11133) 2024-06-05 15:04:55 +08:00
arc-perf-test.yaml Update tests for transformers 4.36 (#10858) 2024-05-24 10:26:38 +08:00
arc-perf-transformers-437-batch2.yaml Modify the check_results.py to support batch 2&4 (#11133) 2024-06-05 15:04:55 +08:00
arc-perf-transformers-437.yaml Add phi3 to the nightly test (#10885) 2024-04-25 17:39:12 +08:00
check_results.py Modify the check_results.py to support batch 2&4 (#11133) 2024-06-05 15:04:55 +08:00
concat_csv.py [LLM] Add qwen1.5-7B in iGPU perf (#10127) 2024-02-07 22:31:20 +08:00
core-perf-test.yaml Update igpu perf internlm (#10958) 2024-05-08 14:16:43 +08:00
cpu-perf-test.yaml update spr perf test (#10644) 2024-04-03 15:53:55 +08:00
csv_to_html.py Modify the check_results.py to support batch 2&4 (#11133) 2024-06-05 15:04:55 +08:00
stable-version-arc-perf-test-fp8.yaml Arc Stable version test (#10087) 2024-02-06 10:23:50 +08:00
stable-version-arc-perf-test-sym_int4.yaml Arc Stable version test (#10087) 2024-02-06 10:23:50 +08:00
stable-version-arc-stress-test-fp8.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
stable-version-arc-stress-test-sym_int4.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
stable-version-cpu-perf-test.yaml Update tests for transformers 4.36 (#10858) 2024-05-24 10:26:38 +08:00
stable-version-cpu-stress-test.yaml Update tests for transformers 4.36 (#10858) 2024-05-24 10:26:38 +08:00