ipex-llm/python
Yuwen Hu 001c13243e [LLM] Add support for low_low_bit benchmark on Windows GPU (#10167)
* Add support for low_low_bit performance test on Windows GPU

* Small fix

* Small fix

* Save memory during converting model process

* Drop the results for first time when loading in low bit on mtl igpu for better performance

* Small fix
2024-02-21 10:51:52 +08:00
..
llm [LLM] Add support for low_low_bit benchmark on Windows GPU (#10167) 2024-02-21 10:51:52 +08:00