History

Jin, Qiao 808d9a7bae Add MiniCPM-V-2 GPU example (#11699 ) * Add MiniCPM-V-2 GPU example * add example in README.md * add example in README.md		2024-08-06 10:22:33 +08:00
..
Advanced-Quantizations	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
LLM	Add Llama3.1 example (#11689 )	2024-07-31 10:53:30 +08:00
More-Data-Types	Update README.md (#11530 )	2024-07-08 20:18:41 +08:00
Multimodal	Add MiniCPM-V-2 GPU example (#11699 )	2024-08-06 10:22:33 +08:00
Save-Load	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
README.md	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00

Running HuggingFace models using IPEX-LLM on Intel GPU

This folder contains examples of running any HuggingFace model on IPEX-LLM:

LLM: examples of running large language models (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) using IPEX-LLM optimizations
Multimodal: examples of running large multimodal models (StableDiffusion models, Qwen-VL-Chat, glm-4v, etc.) using IPEX-LLM optimizations
More-Data-Types: examples of applying other low bit optimizations (FP8/INT8/FP4, etc.)
Save-Load: examples of saving and loading low-bit models
Advanced-Quantizations: examples of loading GGUF/AWQ/GPTQ models