Yina Chen
								
							 
						 | 
						
							
							
							
							
								
							
							
								404e101ded
								
							
						 | 
						
							
							
								
								QALora example (#9551)
							
							
							
							
							
							
							
							* Support qa-lora
* init
* update
* update
* update
* update
* update
* update merge
* update
* fix style & update scripts
* update
* address comments
* fix typo
* fix typo
---------
Co-authored-by: Yang Wang <yang3.wang@intel.com> 
							
						 | 
						
							2023-12-06 15:36:21 +08:00 | 
						
						
							
							
							
								
							
							
						 | 
					
				
					
						
							
								
								
									 
									Wang, Jian4
								
							 
						 | 
						
							
							
							
							
								
							
							
								ed0dc57c6e
								
							
						 | 
						
							
							
								
								LLM: Add cpu qlora support other models guide (#9567)
							
							
							
							
							
							
							
							* use bf16 flag
* add using baichuan model
* update merge
* remove
* update 
							
						 | 
						
							2023-12-01 11:18:04 +08:00 | 
						
						
							
							
							
								
							
							
						 | 
					
				
					
						
							
								
								
									 
									Ruonan Wang
								
							 
						 | 
						
							
							
							
							
								
							
							
								076d106ef5
								
							
						 | 
						
							
							
								
								LLM: GPU QLoRA update to bf16 to accelerate gradient checkpointing (#9499)
							
							
							
							
							
							
							
							* update to bf16 to accelerate gradient checkpoint
* add utils and fix ut 
							
						 | 
						
							2023-11-21 17:08:36 +08:00 | 
						
						
							
							
							
								
							
							
						 | 
					
				
					
						
							
								
								
									 
									binbin Deng
								
							 
						 | 
						
							
							
							
							
								
							
							
								5e9962b60e
								
							
						 | 
						
							
							
								
								LLM: update example layout (#9046)
							
							
							
							
							
						 | 
						
							2023-10-09 15:36:39 +08:00 | 
						
						
							
							
							
								
							
							
						 |