Shaojun Liu 2cce89691a Enable use_batch_forward Optimization on Battlemage GPU (#12516) ... * Update get_xpu_device_type() to support bmg * enable use_batch_forward for bmg * Update low_bit_linear.py * Update utils.py * use batch kernel for fp8e5		2024-12-12 12:44:36 +08:00
..
llm	Enable use_batch_forward Optimization on Battlemage GPU (#12516)	2024-12-12 12:44:36 +08:00