ipex-llm/python/llm/test/benchmark/perplexity/fp16.csv
hxsz1997 cba61a2909 Add html report of ppl (#10218)
* remove include and language option, select the corresponding dataset based on the model name in Run

* change the nightly test time

* change the nightly test time of harness and ppl

* save the ppl result to json file

* generate csv file and print table result

* generate html

* modify the way to get parent folder

* update html in parent folder

* add llm-ppl-summary and llm-ppl-summary-html

* modify echo single result

* remove download fp16.csv

* change model name of PR

* move ppl nightly related files to llm/test folder

* reformat

* seperate make_table from make_table_and_csv.py

* separate make_csv from make_table_and_csv.py

* update llm-ppl-html

* remove comment

* add Download fp16.results
2024-02-27 17:37:08 +08:00

253 B

1IndexModelPrecisionenzh
20Llama-2-7b-chat-hffp164.7019
31chatglm2-6bfp1622.321
42chatglm3-6bfp1630.1281
53Baichuan2-7B-Chatfp1610.7676
64mpt-7b-chatfp165.7882
75falcon-7b-instruct-with-patchfp165.2532
86mistral-7b-v0.1fp163.6597