Ruonan Wang e9aa2bd890 LLM: reduce GPU 1st token latency and update example (#8763) ... * reduce 1st token latency * update example * fix * fix style * update readme of gpu benchmark		2023-08-16 18:01:23 +08:00
..
llm	LLM: reduce GPU 1st token latency and update example (#8763)	2023-08-16 18:01:23 +08:00