ipex-llm/python/llm/test
hxsz1997 cba61a2909 Add html report of ppl (#10218)
* remove include and language option, select the corresponding dataset based on the model name in Run

* change the nightly test time

* change the nightly test time of harness and ppl

* save the ppl result to json file

* generate csv file and print table result

* generate html

* modify the way to get parent folder

* update html in parent folder

* add llm-ppl-summary and llm-ppl-summary-html

* modify echo single result

* remove download fp16.csv

* change model name of PR

* move ppl nightly related files to llm/test folder

* reformat

* seperate make_table from make_table_and_csv.py

* separate make_csv from make_table_and_csv.py

* update llm-ppl-html

* remove comment

* add Download fp16.results
2024-02-27 17:37:08 +08:00
..
benchmark Add html report of ppl (#10218) 2024-02-27 17:37:08 +08:00
convert LLM: Adapt transformers models for optimize model SL (#9022) 2023-10-09 11:13:44 +08:00
inference [LLM] Add UTs of load_low_bit for transformers-style API (#10001) 2024-01-29 10:18:23 +08:00
inference_gpu LLM: Add mlp layer unit tests (#10200) 2024-02-22 13:44:45 +08:00
install [LLM] Refactor LLM Linux tests (#8349) 2023-06-16 15:22:48 +08:00
langchain LLM: modify transformersembeddings.embed() in langchain (#10051) 2024-02-05 10:42:10 +08:00
win [LLM] Remove old windows nightly test code (#8668) 2023-08-03 17:12:23 +09:00
__init__.py [LLM] Enable UT workflow logics for LLM (#8243) 2023-06-02 17:06:35 +08:00
run-llm-convert-tests.sh [LLM] Change default runner for LLM Linux tests to the ones with AVX512 (#8448) 2023-07-04 14:53:03 +08:00
run-llm-example-tests-gpu.sh LLM: reorganize GPU finetuning examples (#9952) 2024-01-25 19:02:38 +08:00
run-llm-inference-tests-gpu-434.sh LLM: Add mlp layer unit tests (#10200) 2024-02-22 13:44:45 +08:00
run-llm-inference-tests-gpu.sh LLM: Add mlp layer unit tests (#10200) 2024-02-22 13:44:45 +08:00
run-llm-inference-tests.sh [LLM] Add UTs of load_low_bit for transformers-style API (#10001) 2024-01-29 10:18:23 +08:00
run-llm-install-tests.sh [LLM] Refactor LLM Linux tests (#8349) 2023-06-16 15:22:48 +08:00
run-llm-langchain-tests.sh [LLM] langchain bloom, UT's, default parameters (#8357) 2023-06-25 17:38:00 +08:00
run-llm-windows-tests.sh LLM: fix langchain windows failure (#8417) 2023-06-30 09:59:10 +08:00