History

Jiao Wang 1e817926ba Fix low memory generation example issue in transformers 4.36 (#10702 ) * update cache in low memory generate * update		2024-04-09 09:56:52 -07:00
..
aquila2	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
baichuan	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
baichuan2	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
bark	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
bluelm	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
chatglm2	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
chatglm3	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
codellama	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
deciLM-7b	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
deepseek	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
distil-whisper	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
dolly-v1	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
dolly-v2	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
flan-t5	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
internlm2	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
llama2	Fix low memory generation example issue in transformers 4.36 (#10702 )	2024-04-09 09:56:52 -07:00
llava	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
mamba	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
mistral	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
mixtral	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
phi-1_5	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
phi-2	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
phixtral	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
qwen-vl	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
qwen1.5	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
replit	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
solar	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
speech-t5	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
stablelm	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
starcoder	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
yi	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
yuan2	Upgrade to python 3.11 (#10711 )	2024-04-09 17:41:17 +08:00
README.md	Update_document by heyang (#30 )	2024-03-25 10:06:02 +08:00

README.md

IPEX-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.