ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
2029 commits 1 branch 0 tags 37 MiB
Commit graph

3 commits

Author SHA1 Message Date
Ruonan Wang
60b35db1f1 LLM: add chatglm3 speculative decoding example (#9966) 
* add chatglm3 example

* update

* fix
 2024-01-23 15:54:12 +08:00
Ruonan Wang
27b19106f3 LLM: add readme for speculative decoding gpu examples (#9961) 
* add readme

* add readme

* meet code review
 2024-01-23 12:54:19 +08:00
Ruonan Wang
3e601f9a5d LLM: Support speculative decoding in bigdl-llm (#9951) 
* first commit

* fix error, add llama example

* hidden print

* update api usage

* change to api v3

* update

* meet code review

* meet code review, fix style

* add reference, fix style

* fix style

* fix first token time
 2024-01-22 19:14:56 +08:00