ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
1287 commits 1 branch 0 tags 37 MiB
Commit graph

2 commits

Author SHA1 Message Date
Ruonan Wang
8805186f2f LLM: add benchmark tool for gpu (#8760) 
* add benchmark tool for gpu

* update
 2023-08-16 11:22:10 +08:00
Ruonan Wang
64b38e1dc8 llm: benchmark tool for transformers int4 (separate 1st token and rest) (#8460) 
* add benchmark utils

* fix

* fix bug and add readme

* hidden latency data
 2023-07-06 09:49:52 +08:00