2 lines
		
	
	
	
		
			466 B
		
	
	
	
		
			Markdown
		
	
	
	
	
	
			
		
		
	
	
			2 lines
		
	
	
	
		
			466 B
		
	
	
	
		
			Markdown
		
	
	
	
	
	
# IPEX-LLM Transformers INT4 Optimization for Large Language Model on Intel GPUs
 | 
						|
You can use IPEX-LLM to run almost every Huggingface Transformer models with INT4 optimizations on your laptops with Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.
 |