ipex-llm/python/llm/example/GPU/PyTorch-Models/Model
2024-08-22 16:12:09 +08:00
..
aquila2
baichuan
baichuan2
bark Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
bluelm
chatglm2
chatglm3
codegeex2
codegemma
codellama change 5 pytorch/huggingface models to fp16 (#11894) 2024-08-22 16:12:09 +08:00
cohere
deciLM-7b
deepseek
distil-whisper
dolly-v1
dolly-v2
flan-t5
glm4
internlm2 change 5 pytorch/huggingface models to fp16 (#11894) 2024-08-22 16:12:09 +08:00
llama2
llama3
llava Update ipex-llm default transformers version to 4.37.0 (#11859) 2024-08-20 17:37:58 +08:00
mamba Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
minicpm
mistral change 5 pytorch/huggingface models to fp16 (#11894) 2024-08-22 16:12:09 +08:00
mixtral
openai-whisper
phi-1_5
phi-2
phi-3
phixtral
qwen-vl
qwen1.5
qwen2
replit
solar change 5 pytorch/huggingface models to fp16 (#11894) 2024-08-22 16:12:09 +08:00
speech-t5 Update README.md (#11889) 2024-08-22 09:40:16 +08:00
stablelm
starcoder
yi
yuan2
README.md

IPEX-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.