Chen, Zhentao
								
							 
						 | 
						
							
							
								
								
							
							
							
								
							
							
								d59e0cce5c
								
							
						 | 
						
							
							
								
								Migrate harness to ipexllm (#10703)
							
							
							
							
							
							
							
							* migrate to ipexlm
* fix workflow
* fix run_multi
* fix precision map
* rename ipexlm to ipexllm
* rename bigdl to ipex  in comments 
							
						 | 
						
							2024-04-09 15:48:53 +08:00 | 
						
						
							
							
							
								
							
							
						 | 
					
				
					
						
							
								
								
									 
									Chen, Zhentao
								
							 
						 | 
						
							
							
							
							
								
							
							
								7fd7c37e1b
								
							
						 | 
						
							
							
								
								Enable fp8e5 harness (#9761)
							
							
							
							
							
							
							
							* fix precision format like fp8e5
* match fp8_e5m2 
							
						 | 
						
							2023-12-22 16:59:48 +08:00 | 
						
						
							
							
							
								
							
							
						 | 
					
				
					
						
							
								
								
									 
									Chen, Zhentao
								
							 
						 | 
						
							
							
							
							
								
							
							
								4d7d5d4c59
								
							
						 | 
						
							
							
								
								Add 3 leaderboard tasks (#9566)
							
							
							
							
							
							
							
							* update leaderboard map
* download model and dataset without overwritten
* fix task drop
* run on all available devices 
							
						 | 
						
							2023-12-01 14:01:14 +08:00 | 
						
						
							
							
							
								
							
							
						 | 
					
				
					
						
							
								
								
									 
									Chen, Zhentao
								
							 
						 | 
						
							
							
							
							
								
							
							
								d19ca21957
								
							
						 | 
						
							
							
								
								patch bigdl-llm model to harness by binding instead of patch file (#9420)
							
							
							
							
							
							
							
							* add run_llb.py
* fix args interpret
* modify outputs
* update workflow
* add license
* test mixed 4 bit
* update readme
* use autotokenizer
* add timeout
* refactor workflow file
* fix working directory
* fix env
* throw exception if some jobs failed
* improve terminal outputs
* Disable var which cause the run stuck
* fix unknown precision
* fix key error
* directly output config instead
* rm harness submodule 
							
						 | 
						
							2023-11-14 12:51:39 +08:00 | 
						
						
							
							
							
								
							
							
						 |