ipex-llm/python
Yina Chen 36c665667d Add logits processor & qwen eos stop in speculative decoding (#9963)
* add logits processor & qwen eos

* fix style

* fix

* fix

* fix style

* fix style

* support transformers 4.31

* fix style

* fix style

---------

Co-authored-by: rnwang04 <ruonan1.wang@intel.com>
2024-01-23 15:57:28 +08:00
..
llm Add logits processor & qwen eos stop in speculative decoding (#9963) 2024-01-23 15:57:28 +08:00