ipex-llm/python/llm/src/ipex_llm/transformers
Xin Qiu e764f9b1b1
Disable fast fused rope on UHD (#10780)
* use decoding fast path

* update

* update

* cleanup
2024-04-18 10:03:53 +08:00
..
awq Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
gguf Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
layers Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
models Disable fast fused rope on UHD (#10780) 2024-04-18 10:03:53 +08:00
__init__.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
bmm.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
convert.py LLM: fix qwen AutoTP (#10766) 2024-04-16 09:56:17 +08:00
convert_ipex.py LLM: Fix no return_last_logit running bigdl_ipex chatglm3 (#10678) 2024-04-07 15:27:58 +08:00
embedding.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
kv.py optimize starcoder normal kv cache (#10642) 2024-04-03 15:27:02 +08:00
load_config.yaml Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
loader.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
lookup.py Add lookahead GPU example (#10785) 2024-04-17 17:41:55 +08:00
low_bit_linear.py LLM: fix AttributeError of FP16Linear (#10740) 2024-04-11 17:03:56 +08:00
model.py Support prompt lookup in ipex-llm (#10768) 2024-04-16 16:52:38 +08:00
modelling_bigdl.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
qlora.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
relora.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
speculative.py Add lookahead GPU example (#10785) 2024-04-17 17:41:55 +08:00
training_patch.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
utils.py Disable fast fused rope on UHD (#10780) 2024-04-18 10:03:53 +08:00
xpu_customize_fwd.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00