ipex-llm/python
Qiyuan Gong 3998de14f0
Fix mistral forward_qkv in q4_0 (#11781)
* Fix mistral forward_qkv without self.rotary_emb.base in q4_0.
* Replace apply_rotary_pos_emb_no_cache_xpu with rotary_half_inplaced.
* Revert https://github.com/intel-analytics/ipex-llm/pull/11765
2024-08-13 16:48:19 +08:00
..
llm Fix mistral forward_qkv in q4_0 (#11781) 2024-08-13 16:48:19 +08:00