ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example
History
Wang, Jian4 4ceefc9b18 LLM: Support bitsandbytes config on qlora finetune (#9715) 
* test support bitsandbytesconfig

* update style

* update cpu example

* update example

* update readme

* update unit test

* use bfloat16

* update logic

* use int4

* set defalut bnb_4bit_use_double_quant

* update

* update example

* update model.py

* update

* support lora example
2024-01-04 11:23:16 +08:00
..
CPU LLM: Support bitsandbytes config on qlora finetune (#9715) 2024-01-04 11:23:16 +08:00
GPU LLM: Support bitsandbytes config on qlora finetune (#9715) 2024-01-04 11:23:16 +08:00