14 commits

Author	SHA1	Message	Date
binbin Deng	171fb2d185	LLM: reorganize GPU finetuning examples (#9952)	2024-01-25 19:02:38 +08:00
Yuwen Hu	023679459e	[LLM] Small fixes for finetune related examples and UTs (#9870)	2024-01-09 18:05:03 +08:00
Yuwen Hu	23fc888abe	Update llm gpu xpu default related info to PyTorch 2.1 (#9866)	2024-01-09 15:38:47 +08:00
Wang, Jian4	4ceefc9b18	LLM: Support bitsandbytes config on qlora finetune (#9715) ... * test support bitsandbytesconfig * update style * update cpu example * update example * update readme * update unit test * use bfloat16 * update logic * use int4 * set defalut bnb_4bit_use_double_quant * update * update example * update model.py * update * support lora example	2024-01-04 11:23:16 +08:00
Ruonan Wang	1917bbe626	LLM: fix BF16Linear related training & inference issue (#9755) ... * fix bf16 related issue * fix * update based on comment & add arc lora script * update readme * update based on comment * update based on comment * update * force to bf16 * fix style * move check input dtype into function * update convert * meet code review * meet code review * update merged model to support new training_mode api * fix typo	2023-12-25 14:49:30 +08:00
Yina Chen	449b387125	Support relora in bigdl-llm (#9687) ... * init * fix style * update * support resume & update readme * update * update * remove important * add training mode * meet comments	2023-12-25 14:04:28 +08:00
Ruonan Wang	2f36769208	LLM: bigdl-llm lora support & lora example (#9740) ... * lora support and single card example * support multi-card, refactor code * fix model id and style * remove torch patch, add two new class for bf16, update example * fix style * change to training_mode * small fix * add more info in help * fixstyle, update readme * fix ut * fix ut * Handling compatibility issues with default LoraConfig	2023-12-22 11:05:39 +08:00
binbin Deng	12df70953e	LLM: add resume_from_checkpoint related section (#9705)	2023-12-18 12:27:02 +08:00
binbin Deng	499100daf1	LLM: Add solution to fix oneccl related error (#9630)	2023-12-08 10:51:55 +08:00
Yina Chen	404e101ded	QALora example (#9551) ... * Support qa-lora * init * update * update * update * update * update * update merge * update * fix style & update scripts * update * address comments * fix typo * fix typo --------- Co-authored-by: Yang Wang <yang3.wang@intel.com>	2023-12-06 15:36:21 +08:00
binbin Deng	1a2129221d	LLM: support resume from checkpoint in Alpaca QLoRA (#9502)	2023-11-22 13:49:14 +08:00
binbin Deng	b7ae572ac3	LLM: update Alpaca QLoRA finetuning example on GPU (#9492)	2023-11-21 14:22:19 +08:00
binbin Deng	3dac21ac7b	LLM: add more example usages about alpaca qlora on different hardware (#9458)	2023-11-17 09:56:43 +08:00
binbin Deng	54d95e4907	LLM: add alpaca qlora finetuning example (#9276)	2023-11-08 16:25:17 +08:00