History

Chu,Youcheng acd77d9e87 Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 ) * fix: remove BIGDL_LLM_XMX_DISABLED in mddocs * fix: remove set SYCL_CACHE_PERSISTENT=1 in example * fix: remove BIGDL_LLM_XMX_DISABLED in workflows * fix: merge igpu and A-series Graphics * fix: remove set BIGDL_LLM_XMX_DISABLED=1 in example * fix: remove BIGDL_LLM_XMX_DISABLED in workflows * fix: merge igpu and A-series Graphics * fix: textual adjustment * fix: textual adjustment * fix: textual adjustment		2024-11-27 11:16:36 +08:00
..
aquila2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
baichuan	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
baichuan2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
bark	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
bluelm	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
chatglm2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
chatglm3	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
codegeex2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
codegemma	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
codellama	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
cohere	Fix cohere model on transformers>=4.41 (#11575 )	2024-07-17 17:18:59 -07:00
deciLM-7b	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
deepseek	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
distil-whisper	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
dolly-v1	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
dolly-v2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
flan-t5	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
glm4	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
internlm2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
llama2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
llama3	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
llama3.2-vision	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
llava	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
mamba	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
minicpm	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
mistral	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
mixtral	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
openai-whisper	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
phi-1_5	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
phi-2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
phi-3	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
phixtral	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
qwen-vl	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
qwen1.5	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
qwen2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
qwen2-vl	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
replit	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
solar	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
speech-t5	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
stablelm	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
starcoder	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
yi	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
yuan2	Remove env variable `BIGDL_LLM_XMX_DISABLED` in documentation (#12445 )	2024-11-27 11:16:36 +08:00
README.md	Update_document by heyang (#30 )	2024-03-25 10:06:02 +08:00

README.md

IPEX-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.