Wang, Jian4
|
7d103417b8
|
Fix glm4-9b-chat nan error on vllm 0.3.3 (#11970)
* fix nan value
* update
|
2024-08-30 09:50:18 +08:00 |
|
Xiangyu Tian
|
7ca557aada
|
LLM: Fix vLLM CPU convert error (#11926)
|
2024-08-27 09:22:19 +08:00 |
|
Guancheng Fu
|
537c0d2767
|
fix vllm qwen2 models (#11879)
|
2024-08-21 11:05:24 +08:00 |
|
Guancheng Fu
|
e70ae0638e
|
Fix vLLM not convert issues (#11817)
* Fix not convert issues
* refine
|
2024-08-15 19:04:05 +08:00 |
|
Xiangyu Tian
|
044e486480
|
Fix vLLM CPU /chat endpoint (#11748)
|
2024-08-09 10:33:52 +08:00 |
|
Guancheng Fu
|
06930ab258
|
Enable ipex-llm optimization for lm head (#11589)
* basic
* Modify convert.py
* fix
|
2024-07-16 16:48:44 +08:00 |
|
Xiangyu Tian
|
b30bf7648e
|
Fix vLLM CPU api_server params (#11384)
|
2024-06-21 13:00:06 +08:00 |
|
Xiangyu Tian
|
4b07712fd8
|
LLM: Fix vLLM CPU model convert mismatch (#11254)
Fix vLLM CPU model convert mismatch.
|
2024-06-07 15:54:34 +08:00 |
|
Xiangyu Tian
|
ac3d53ff5d
|
LLM: Fix vLLM CPU version error (#11206)
Fix vLLM CPU version error
|
2024-06-04 19:10:23 +08:00 |
|
Xiangyu Tian
|
b3f6faa038
|
LLM: Add CPU vLLM entrypoint (#11083)
Add CPU vLLM entrypoint and update CPU vLLM serving example.
|
2024-05-24 09:16:59 +08:00 |
|
Guancheng Fu
|
990535b1cf
|
Add tensor parallel for vLLM (#10879)
* initial
* test initial tp
* initial sup
* fix format
* fix
* fix
|
2024-04-26 17:10:49 +08:00 |
|
Guancheng Fu
|
47bd5f504c
|
[vLLM]Remove vllm-v1, refactor v2 (#10842)
* remove vllm-v1
* fix format
|
2024-04-22 17:51:32 +08:00 |
|
Xiangyu Tian
|
08018a18df
|
Remove not-imported MistralConfig (#10670)
|
2024-04-07 10:32:05 +08:00 |
|
Jiao Wang
|
69bdbf5806
|
Fix vllm print error message issue (#10664)
* update chatglm readme
* Add condition to invalidInputError
* update
* update
* style
|
2024-04-05 15:08:13 -07:00 |
|
Shaojun Liu
|
a10f5a1b8d
|
add python style check (#10620)
* add python style check
* fix style checks
* update runner
* add ipex-llm-finetune-qlora-cpu-k8s to manually_build workflow
* update tag to 2.1.0-SNAPSHOT
|
2024-04-02 16:17:56 +08:00 |
|
Wang, Jian4
|
9df70d95eb
|
Refactor bigdl.llm to ipex_llm (#24)
* Rename bigdl/llm to ipex_llm
* rm python/llm/src/bigdl
* from bigdl.llm to from ipex_llm
|
2024-03-22 15:41:21 +08:00 |
|