Yishuo Wang
|
437a349dd6
|
fix rwkv with pip installer (#10591)
|
2024-03-29 17:56:45 +08:00 |
|
Ruonan Wang
|
0136fad1d4
|
LLM: support iq1_s (#10564)
* init version
* update utils
* remove unsed code
|
2024-03-29 09:43:55 +08:00 |
|
Qiyuan Gong
|
f4537798c1
|
Enable kv cache quantization by default for flex when 1 < batch <= 8 (#10584)
* Enable kv cache quantization by default for flex when 1 < batch <= 8.
* Change up bound from <8 to <=8.
|
2024-03-29 09:43:42 +08:00 |
|
Cengguang Zhang
|
b44f7adbad
|
LLM: Disable esimd sdp for PVC GPU when batch size>1 (#10579)
* llm: disable esimd sdp for pvc bz>1.
* fix logic.
* fix: avoid call get device name twice.
|
2024-03-28 22:55:48 +08:00 |
|
Xin Qiu
|
5963239b46
|
Fix qwen's position_ids no enough (#10572)
* fix position_ids
* fix position_ids
|
2024-03-28 17:05:49 +08:00 |
|
ZehuaCao
|
52a2135d83
|
Replace ipex with ipex-llm (#10554)
* fix ipex with ipex_llm
* fix ipex with ipex_llm
* update
* update
* update
* update
* update
* update
* update
* update
|
2024-03-28 13:54:40 +08:00 |
|
binbin Deng
|
92dfed77be
|
LLM: fix abnormal output of fp16 deepspeed autotp (#10558)
|
2024-03-28 09:35:48 +08:00 |
|
Xiangyu Tian
|
51d34ca68e
|
Fix wrong import in speculative (#10562)
|
2024-03-27 18:21:07 +08:00 |
|
Ruonan Wang
|
ea4bc450c4
|
LLM: add esimd sdp for pvc (#10543)
* add esimd sdp for pvc
* update
* fix
* fix batch
|
2024-03-26 19:04:40 +08:00 |
|
Xiangyu Tian
|
11550d3f25
|
LLM: Add length check for IPEX-CPU speculative decoding (#10529)
Add length check for IPEX-CPU speculative decoding.
|
2024-03-26 17:47:10 +08:00 |
|
Yishuo Wang
|
69a28d6b4c
|
fix chatglm (#10540)
|
2024-03-26 16:01:00 +08:00 |
|
binbin Deng
|
0a3e4e788f
|
LLM: fix mistral hidden_size setting for deepspeed autotp (#10527)
|
2024-03-26 10:55:44 +08:00 |
|
Xin Qiu
|
1dd40b429c
|
enable fp4 fused mlp and qkv (#10531)
* enable fp4 fused mlp and qkv
* update qwen
* update qwen2
|
2024-03-26 08:34:00 +08:00 |
|
Wang, Jian4
|
9df70d95eb
|
Refactor bigdl.llm to ipex_llm (#24)
* Rename bigdl/llm to ipex_llm
* rm python/llm/src/bigdl
* from bigdl.llm to from ipex_llm
|
2024-03-22 15:41:21 +08:00 |
|