ipex-llm/python
Cengguang Zhang 7c43ac0164
LLM: optimize llama natvie sdp for split qkv tensor (#10693)
* LLM: optimize llama natvie sdp for split qkv tensor.

* fix block real size.

* fix comment.

* fix style.

* refactor.
2024-04-08 17:48:11 +08:00
..
llm LLM: optimize llama natvie sdp for split qkv tensor (#10693) 2024-04-08 17:48:11 +08:00