Yina Chen dd46c141bd Phi3 support compresskv (#11733) ... * phi3 support compresskv * fix phi3 mtl error * fix conflict with quant kv * fix abnormal on mtl * fix style * use slide windows size to compress kv * support sliding window * fix style * fix style * temp: partial support quant kv * support quant kv with compress kv, todo: model check * temp * fix style * fix style * remove prepare * address comment * default -> 1.8k		2024-08-09 15:43:43 +08:00
..
llm	Phi3 support compresskv (#11733)	2024-08-09 15:43:43 +08:00