History

ZehuaCao 56cb992497 LLM: Modify CPU Installation Command for most examples (#11049 ) * init * refine * refine * refine * modify hf-agent example * modify all CPU model example * remove readthedoc modify * replace powershell with cmd * fix repo * fix repo * update * remove comment on windows code block * update * update * update * update --------- Co-authored-by: xiangyuT <xiangyu.tian@intel.com>		2024-05-17 15:52:20 +08:00
..
aquila2	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
baichuan	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
baichuan2	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
bark	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
bluelm	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
chatglm2	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
chatglm3	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
codegemma	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
codellama	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
cohere	LLM: Modify CPU Installation Command for most examples (#11049 )	2024-05-17 15:52:20 +08:00
deciLM-7b	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
deepseek	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
distil-whisper	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
dolly-v1	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
dolly-v2	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
flan-t5	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
internlm2	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
llama2	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
llama3	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
llava	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
mamba	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
mistral	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
mixtral	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
phi-1_5	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
phi-2	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
phi-3	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
phixtral	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
qwen-vl	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
qwen1.5	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
replit	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
solar	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
speech-t5	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
stablelm	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
starcoder	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
yi	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
yuan2	Remove oneAPI pip install command in related examples (#11030 )	2024-05-16 10:46:29 +08:00
README.md	Update_document by heyang (#30 )	2024-03-25 10:06:02 +08:00

README.md

IPEX-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.