ZehuaCao
|
0646e2c062
|
Fix short prompt for IPEX_CPU speculative decoding cause no_attr error (#10783)
|
2024-04-17 16:19:57 +08:00 |
|
Wang, Jian4
|
9df70d95eb
|
Refactor bigdl.llm to ipex_llm (#24)
* Rename bigdl/llm to ipex_llm
* rm python/llm/src/bigdl
* from bigdl.llm to from ipex_llm
|
2024-03-22 15:41:21 +08:00 |
|
Heyang Sun
|
177273c1a4
|
IPEX Speculative Support for Baichuan2 7B (#10112)
* IPEX Speculative Support for Baichuan2 7B
* fix license problems
* refine
|
2024-02-19 09:12:57 +08:00 |
|
Xiangyu Tian
|
9978089796
|
[LLM] Enable BIGDL_OPT_IPEX in speculative baichuan2 13b example (#10028)
Enable BIGDL_OPT_IPEX in speculative baichuan2 13b example
|
2024-01-30 17:11:37 +08:00 |
|
Heyang Sun
|
cc3f122f6a
|
Baichuan2 CPU example of speculative decoding (#10003)
* Baichuan2 CPU example of speculative decoding
* Update generate.py
* Update README.md
* Update generate.py
* Update generate.py
* Update generate.py
* fix default model
* fix wrong chinese coding
* Update generate.py
* update prompt
* update sample outputs
* baichuan 7b needs transformers==4.31.0
* rename example file's name
|
2024-01-29 14:21:09 +08:00 |
|