ipex-llm/python/llm/test/benchmark/perplexity/fp16.csv

260 B

1IndexModelPrecisionppl_result
20Llama-2-7b-chat-hffp164.7019
31chatglm2-6bfp1622.321
42chatglm3-6bfp1630.1281
53Baichuan2-7B-Chatfp1610.7676
64mpt-7b-chatfp165.7882
75falcon-7b-instruct-with-patchfp165.2532
86Mistral-7B-v0.1fp163.6597