ipex-llm/python/llm/src/ipex_llm/transformers
Guancheng Fu 2c64754eb0
Add vLLM to ipex-llm serving image (#10807)
* add vllm

* done

* doc work

* fix done

* temp

* add docs

* format

* add start-fastchat-service.sh

* fix
2024-04-29 17:25:42 +08:00
..
awq Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
gguf Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
layers Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
models remove new_layout parameter (#10906) 2024-04-29 10:31:50 +08:00
__init__.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
bmm.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
convert.py Add vLLM to ipex-llm serving image (#10807) 2024-04-29 17:25:42 +08:00
convert_ipex.py LLM: Fix bigdl_ipex_int8 warning (#10890) 2024-04-26 11:18:44 +08:00
embedding.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
kv.py remove new_layout parameter (#10906) 2024-04-29 10:31:50 +08:00
lisa.py LISA Finetuning Example (#10743) 2024-04-18 13:48:10 +08:00
load_config.yaml Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
loader.py Fix Loader issue with dtype fp16 (#10907) 2024-04-29 10:16:02 +08:00
lookup.py Fix lookahead sample error & add update strategy (#10894) 2024-04-28 17:21:00 +08:00
low_bit_linear.py Add tensor parallel for vLLM (#10879) 2024-04-26 17:10:49 +08:00
model.py Support the desc_act feature in GPTQ model (#10851) 2024-04-24 10:17:13 -07:00
modelling_bigdl.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
qlora.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
relora.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
speculative.py Fix speculative decoding bug (#10855) 2024-04-23 14:28:31 +08:00
training_patch.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
utils.py Disable fast fused rope on UHD (#10780) 2024-04-18 10:03:53 +08:00
xpu_customize_fwd.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00