ipex-llm/python
Yuwen Hu 8fdc36c140
Optimize with new batch kernel when batch_size=1 on LNL (#12419)
* Add use batch kernel condition for LNL

* Fix for other device judgement

* Fix based on comment
2024-11-21 16:21:35 +08:00
..
llm Optimize with new batch kernel when batch_size=1 on LNL (#12419) 2024-11-21 16:21:35 +08:00