4 commits

Author	SHA1	Message	Date
Ruonan Wang	057e77e229	LLM: update benchmark_utils.py to handle do_sample=True (#8903)	2023-09-07 14:20:47 +08:00
Xin Qiu	49a39452c6	update benchmark (#8899)	2023-09-06 15:11:43 +08:00
Song Jiaming	b8b1b6888b	[LLM] Performance test (#8796)	2023-08-25 14:31:45 +08:00
Ruonan Wang	64b38e1dc8	llm: benchmark tool for transformers int4 (separate 1st token and rest) (#8460) ... * add benchmark utils * fix * fix bug and add readme * hidden latency data	2023-07-06 09:49:52 +08:00