ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example
History
Heyang Sun cc3f122f6a Baichuan2 CPU example of speculative decoding (#10003) 
* Baichuan2 CPU example of speculative decoding

* Update generate.py

* Update README.md

* Update generate.py

* Update generate.py

* Update generate.py

* fix default model

* fix wrong chinese coding

* Update generate.py

* update prompt

* update sample outputs

* baichuan 7b needs transformers==4.31.0

* rename example file's name
2024-01-29 14:21:09 +08:00
..
CPU Baichuan2 CPU example of speculative decoding (#10003) 2024-01-29 14:21:09 +08:00
GPU LLM: GPU Example Updates for Windows (#9992) 2024-01-29 11:25:11 +08:00
Text-Generation-WebUI [LLM] Add Text_Generation_WebUI Support (#9884) 2024-01-26 15:12:49 +08:00