10 commits

Author	SHA1	Message	Date
Ruonan Wang	1917bbe626	LLM: fix BF16Linear related training & inference issue (#9755) ... * fix bf16 related issue * fix * update based on comment & add arc lora script * update readme * update based on comment * update based on comment * update * force to bf16 * fix style * move check input dtype into function * update convert * meet code review * meet code review * update merged model to support new training_mode api * fix typo	2023-12-25 14:49:30 +08:00
Yina Chen	449b387125	Support relora in bigdl-llm (#9687) ... * init * fix style * update * support resume & update readme * update * update * remove important * add training mode * meet comments	2023-12-25 14:04:28 +08:00
Ruonan Wang	2f36769208	LLM: bigdl-llm lora support & lora example (#9740) ... * lora support and single card example * support multi-card, refactor code * fix model id and style * remove torch patch, add two new class for bf16, update example * fix style * change to training_mode * small fix * add more info in help * fixstyle, update readme * fix ut * fix ut * Handling compatibility issues with default LoraConfig	2023-12-22 11:05:39 +08:00
binbin Deng	12df70953e	LLM: add resume_from_checkpoint related section (#9705)	2023-12-18 12:27:02 +08:00
binbin Deng	499100daf1	LLM: Add solution to fix oneccl related error (#9630)	2023-12-08 10:51:55 +08:00
Yina Chen	404e101ded	QALora example (#9551) ... * Support qa-lora * init * update * update * update * update * update * update merge * update * fix style & update scripts * update * address comments * fix typo * fix typo --------- Co-authored-by: Yang Wang <yang3.wang@intel.com>	2023-12-06 15:36:21 +08:00
binbin Deng	1a2129221d	LLM: support resume from checkpoint in Alpaca QLoRA (#9502)	2023-11-22 13:49:14 +08:00
binbin Deng	b7ae572ac3	LLM: update Alpaca QLoRA finetuning example on GPU (#9492)	2023-11-21 14:22:19 +08:00
binbin Deng	3dac21ac7b	LLM: add more example usages about alpaca qlora on different hardware (#9458)	2023-11-17 09:56:43 +08:00
binbin Deng	54d95e4907	LLM: add alpaca qlora finetuning example (#9276)	2023-11-08 16:25:17 +08:00