ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
2079 commits 1 branch 0 tags 37 MiB
Commit graph

3 commits

Author SHA1 Message Date
Xiangyu Tian
9978089796 [LLM] Enable BIGDL_OPT_IPEX in speculative baichuan2 13b example (#10028) 
Enable BIGDL_OPT_IPEX in speculative baichuan2 13b example
 2024-01-30 17:11:37 +08:00
Heyang Sun
cc3f122f6a Baichuan2 CPU example of speculative decoding (#10003) 
* Baichuan2 CPU example of speculative decoding

* Update generate.py

* Update README.md

* Update generate.py

* Update generate.py

* Update generate.py

* fix default model

* fix wrong chinese coding

* Update generate.py

* update prompt

* update sample outputs

* baichuan 7b needs transformers==4.31.0

* rename example file's name
 2024-01-29 14:21:09 +08:00
Wang, Jian4
093e6f8f73 LLM: Add qwen CPU speculative example (#9985) 
* init from gpu

* update for cpu

* update

* update

* fix xpu readme

* update

* update example prompt

* update prompt and add 72b

* update

* update
 2024-01-25 17:01:34 +08:00