ipex-llm/python/llm/src/bigdl
Yang Wang 449aea7ffc Optimize transformer int4 loading memory (#8400)
* Optimize transformer int4 loading memory

* move cast to convert

* default settting low_cpu_mem_usage
2023-06-30 20:12:12 -07:00
..
llm Optimize transformer int4 loading memory (#8400) 2023-06-30 20:12:12 -07:00
__init__.py LLM: add first round files (#8225) 2023-05-25 11:29:18 +08:00