4 commits

Author	SHA1	Message	Date
Jiao Wang	93146b9433	Reconstruct Speculative Decoding example directory (#11136) ... * update * update * update	2024-05-29 13:15:27 -07:00
Wang, Jian4	9df70d95eb	Refactor bigdl.llm to ipex_llm (#24) ... * Rename bigdl/llm to ipex_llm * rm python/llm/src/bigdl * from bigdl.llm to from ipex_llm	2024-03-22 15:41:21 +08:00
Ruonan Wang	60b35db1f1	LLM: add chatglm3 speculative decoding example (#9966) ... * add chatglm3 example * update * fix	2024-01-23 15:54:12 +08:00
Ruonan Wang	3e601f9a5d	LLM: Support speculative decoding in bigdl-llm (#9951) ... * first commit * fix error, add llama example * hidden print * update api usage * change to api v3 * update * meet code review * meet code review, fix style * add reference, fix style * fix style * fix first token time	2024-01-22 19:14:56 +08:00