ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/test/benchmark
History
hxsz1997 cba61a2909 Add html report of ppl (#10218) 
* remove include and language option, select the corresponding dataset based on the model name in Run

* change the nightly test time

* change the nightly test time of harness and ppl

* save the ppl result to json file

* generate csv file and print table result

* generate html

* modify the way to get parent folder

* update html in parent folder

* add llm-ppl-summary and llm-ppl-summary-html

* modify echo single result

* remove download fp16.csv

* change model name of PR

* move ppl nightly related files to llm/test folder

* reformat

* seperate make_table from make_table_and_csv.py

* separate make_csv from make_table_and_csv.py

* update llm-ppl-html

* remove comment

* add Download fp16.results
2024-02-27 17:37:08 +08:00
..
harness Move harness nightly related files to llm/test folder (#10209) 2024-02-23 11:12:36 +08:00
igpu-perf Add yuan2-2b to win igpu perf test (#10250) 2024-02-27 11:08:33 +08:00
perplexity Add html report of ppl (#10218) 2024-02-27 17:37:08 +08:00
arc-perf-test.yaml temporarily disable bloom 2k input (#10056) 2024-01-31 17:49:12 +08:00
arc-perf-transformers-434.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
arc-perf-transformers-437.yaml LLM: add qwen_1.5_7b model for arc perf test (#10166) 2024-02-19 17:21:00 +08:00
check_results.py LLM: check csv and its corresponding yaml file (#9702) 2023-12-21 09:54:33 +08:00
concat_csv.py [LLM] Add qwen1.5-7B in iGPU perf (#10127) 2024-02-07 22:31:20 +08:00
core-perf-test.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
cpu-perf-test.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
csv_to_html.py [LLM] Add model loading time record for all-in-one benchmark (#10201) 2024-02-22 13:57:18 +08:00
stable-version-arc-perf-test-fp8.yaml Arc Stable version test (#10087) 2024-02-06 10:23:50 +08:00
stable-version-arc-perf-test-sym_int4.yaml Arc Stable version test (#10087) 2024-02-06 10:23:50 +08:00
stable-version-arc-stress-test-fp8.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
stable-version-arc-stress-test-sym_int4.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
stable-version-cpu-perf-test.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00
stable-version-cpu-stress-test.yaml Update perf test all-in-one config for batch_size arg (#10012) 2024-01-26 16:46:36 +08:00