ipex-llm/python
Yang Wang 449aea7ffc Optimize transformer int4 loading memory (#8400)
* Optimize transformer int4 loading memory

* move cast to convert

* default settting low_cpu_mem_usage
2023-06-30 20:12:12 -07:00
..
llm Optimize transformer int4 loading memory (#8400) 2023-06-30 20:12:12 -07:00