10 commits

Author	SHA1	Message	Date
Qiyuan Gong	4c487313f2	Revert "[LLM] IPEX auto importer turn on by default for XPU (#9730)" (#9759) ... This reverts commit 0284801fbd.	2023-12-22 16:38:24 +08:00
Qiyuan Gong	0284801fbd	[LLM] IPEX auto importer turn on by default for XPU (#9730) ... * Set BIGDL_IMPORT_IPEX default to true, i.e., auto import IPEX for XPU. * Remove import intel_extension_for_pytorch as ipex from GPU example. * Add support for bigdl-core-xe-21.	2023-12-22 16:20:32 +08:00
Ruonan Wang	2f36769208	LLM: bigdl-llm lora support & lora example (#9740) ... * lora support and single card example * support multi-card, refactor code * fix model id and style * remove torch patch, add two new class for bf16, update example * fix style * change to training_mode * small fix * add more info in help * fixstyle, update readme * fix ut * fix ut * Handling compatibility issues with default LoraConfig	2023-12-22 11:05:39 +08:00
Yina Chen	70f5e7bf0d	Support peft LoraConfig (#9636) ... * support peft loraconfig * use testcase to test * fix style * meet comments	2023-12-08 16:13:03 +08:00
Yina Chen	404e101ded	QALora example (#9551) ... * Support qa-lora * init * update * update * update * update * update * update merge * update * fix style & update scripts * update * address comments * fix typo * fix typo --------- Co-authored-by: Yang Wang <yang3.wang@intel.com>	2023-12-06 15:36:21 +08:00
binbin Deng	4ff2ca9d0d	LLM: fix loss error on Arc (#9550)	2023-11-29 15:16:18 +08:00
Ruonan Wang	076d106ef5	LLM: GPU QLoRA update to bf16 to accelerate gradient checkpointing (#9499) ... * update to bf16 to accelerate gradient checkpoint * add utils and fix ut	2023-11-21 17:08:36 +08:00
Ruonan Wang	0f82b8c3a0	LLM: update qlora example (#9454) ... * update qlora example * fix loss=0	2023-11-15 09:24:15 +08:00
Yang Wang	7a2de00b48	Fixes for xpu Bf16 training (#9156) ... * Support bf16 training * Use a stable transformer version * remove env * fix style	2023-10-14 21:28:59 -07:00
binbin Deng	5e9962b60e	LLM: update example layout (#9046)	2023-10-09 15:36:39 +08:00

Renamed from python/llm/example/gpu/qlora_finetuning/qlora_finetuning.py (Browse further)