ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/GPU/PyTorch-Models/Model
History
Guoqiong Song d64711900a
Fix cohere model on transformers>=4.41 (#11575) 
* fix cohere model for 4-41
2024-07-17 17:18:59 -07:00
..
aquila2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
baichuan Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
baichuan2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
bark Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
bluelm Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
chatglm2 ChatGLM Examples Restructure regarding Installation Steps (#11285) 2024-06-14 12:37:05 +08:00
chatglm3 ChatGLM Examples Restructure regarding Installation Steps (#11285) 2024-06-14 12:37:05 +08:00
codegeex2 Fix codegeex2 transformers version (#11487) 2024-07-02 15:09:28 +08:00
codegemma Miniconda/Anaconda -> Miniforge update in examples (#11194) 2024-06-04 10:14:02 +08:00
codellama Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
cohere Fix cohere model on transformers>=4.41 (#11575) 2024-07-17 17:18:59 -07:00
deciLM-7b Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
deepseek Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
distil-whisper Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
dolly-v1 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
dolly-v2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
flan-t5 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
glm4 ChatGLM Examples Restructure regarding Installation Steps (#11285) 2024-06-14 12:37:05 +08:00
internlm2 Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
llama2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
llama3 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
llava Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
mamba Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
minicpm Add CPU and GPU example for MiniCPM (#11202) 2024-06-05 18:09:53 +08:00
mistral Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
mixtral Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
phi-1_5 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
phi-2 phi-2 transformers 4.37 (#11161) 2024-06-05 13:36:41 -07:00
phi-3 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
phixtral Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
qwen-vl Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
qwen1.5 Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
qwen2 Add qwen2 example (#11252) 2024-06-07 10:29:33 +08:00
replit Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
solar Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
speech-t5 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
stablelm Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
starcoder Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
yi Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
yuan2 Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
README.md Update_document by heyang (#30) 2024-03-25 10:06:02 +08:00

README.md

IPEX-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.