History

binbin Deng 66f6ffe4b2 Update GPU HF-Transformers example structure (#11526 )		2024-07-08 17:58:06 +08:00
..
aquila	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
aquila2
baichuan
baichuan2	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
bluelm	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
chatglm2
chatglm3	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
chinese-llama2
codegeex2	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
codegemma	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
codellama
codeshell
cohere
deciLM-7b
deepseek	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
dolly-v1	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
dolly-v2
falcon
flan-t5	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
gemma	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
glm4
gpt-j
internlm
internlm2
llama2	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
llama3	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
minicpm	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
mistral
mixtral
mpt	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
phi-1_5
phi-2	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
phi-3	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
phixtral	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
qwen	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
qwen1.5
qwen2
redpajama
replit
rwkv4
rwkv5	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
solar
stablelm
starcoder
vicuna	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
yi	Update GPU HF-Transformers example structure (#11526 )	2024-07-08 17:58:06 +08:00
yuan2
README.md

README.md

IPEX-LLM Transformers INT4 Optimization for Large Language Model on Intel GPUs

You can use IPEX-LLM to run almost every Huggingface Transformer models with INT4 optimizations on your laptops with Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.