ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
1208 commits 1 branch 0 tags 37 MiB
Commit graph

1 commit

Author SHA1 Message Date
Ruonan Wang
64b38e1dc8 llm: benchmark tool for transformers int4 (separate 1st token and rest) (#8460) 
* add benchmark utils

* fix

* fix bug and add readme

* hidden latency data
 2023-07-06 09:49:52 +08:00