4 commits

Author	SHA1	Message	Date
Cengguang Zhang	cca84b0a64	LLM: update llm benchmark scripts. (#8943) ... * update llm benchmark scripts. * change tranformer_bf16 to pytorch_autocast_bf16. * add autocast in transformer int4. * revert autocast. * add "pytorch_autocast_bf16" to doc * fix comments.	2023-09-13 12:23:28 +08:00
Cengguang Zhang	3d2efe9608	LLM: update llm latency benchmark. (#8922)	2023-09-07 19:00:19 +08:00
binbin Deng	7897eb4b51	LLM: add benchmark scripts on GPU (#8916)	2023-09-07 18:08:17 +08:00
Song Jiaming	c06f1ca93e	[LLM] auto perf test to output to csv (#8846)	2023-09-01 10:48:00 +08:00