ipex-llm/python/llm/test/benchmark/perplexity/fp16.csv
hxsz1997 cba61a2909 Add html report of ppl (#10218)
* remove include and language option, select the corresponding dataset based on the model name in Run

* change the nightly test time

* change the nightly test time of harness and ppl

* save the ppl result to json file

* generate csv file and print table result

* generate html

* modify the way to get parent folder

* update html in parent folder

* add llm-ppl-summary and llm-ppl-summary-html

* modify echo single result

* remove download fp16.csv

* change model name of PR

* move ppl nightly related files to llm/test folder

* reformat

* seperate make_table from make_table_and_csv.py

* separate make_csv from make_table_and_csv.py

* update llm-ppl-html

* remove comment

* add Download fp16.results
2024-02-27 17:37:08 +08:00

8 lines
No EOL
253 B
Text

Index,Model,Precision,en,zh
0,Llama-2-7b-chat-hf,fp16,4.7019,
1,chatglm2-6b,fp16,,22.321
2,chatglm3-6b,fp16,,30.1281
3,Baichuan2-7B-Chat,fp16,,10.7676
4,mpt-7b-chat,fp16,5.7882,
5,falcon-7b-instruct-with-patch,fp16,5.2532,
6,mistral-7b-v0.1,fp16,3.6597,