Yina Chen dd46c141bd Phi3 support compresskv (#11733) ... * phi3 support compresskv * fix phi3 mtl error * fix conflict with quant kv * fix abnormal on mtl * fix style * use slide windows size to compress kv * support sliding window * fix style * fix style * temp: partial support quant kv * support quant kv with compress kv, todo: model check * temp * fix style * fix style * remove prepare * address comment * default -> 1.8k		2024-08-09 15:43:43 +08:00
..
dev	Add benchmark util for transformers 4.42 (#11725)	2024-08-07 08:48:07 +08:00
example	enable inference mode for deepspeed tp serving (#11742)	2024-08-08 14:38:30 +08:00
portable-zip	Fix null pointer dereferences error. (#11125)	2024-05-30 16:16:10 +08:00
scripts	fix typo in python/llm/scripts/README.md (#11536)	2024-07-09 09:53:14 +08:00
src/ipex_llm	Phi3 support compresskv (#11733)	2024-08-09 15:43:43 +08:00
test	Add qwen2-1.5b-instruct into igpu performance (#11735)	2024-08-08 16:42:18 +08:00
tpp	OSPDT: add tpp licenses (#11165)	2024-06-06 10:59:06 +08:00
.gitignore	[LLM] add chatglm pybinding binary file release (#8677)	2023-08-04 11:45:27 +08:00
setup.py	update doc/setup to use onednn gemm for cpp (#11598)	2024-07-18 13:04:38 +08:00
version.txt	Update setup.py and add new actions and add compatible mode (#25)	2024-03-22 15:44:59 +08:00