ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/GPU/PyTorch-Models/Model
History
Jin Qiao 10ee786920
Replace with IPEX-LLM in example comments (#10671) 
* Replace with IPEX-LLM in example comments

* More replacement

* revert some changes
2024-04-07 13:29:51 +08:00
..
aquila2 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
baichuan Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
baichuan2 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
bark Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
bluelm Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
chatglm2 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
chatglm3 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
codellama Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
deciLM-7b Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
deepseek Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
distil-whisper Update pip install to use --extra-index-url for ipex package (#10557) 2024-03-28 09:56:23 +08:00
dolly-v1 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
dolly-v2 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
flan-t5 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
internlm2 Replace ipex with ipex-llm (#10554) 2024-03-28 13:54:40 +08:00
llama2 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
llava Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
mamba Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
mistral Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
mixtral Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
phi-1_5 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
phi-2 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
phixtral Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
qwen-vl Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
qwen1.5 Update pip install to use --extra-index-url for ipex package (#10557) 2024-03-28 09:56:23 +08:00
replit Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
solar Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
speech-t5 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
stablelm Add GPU and CPU example for stablelm-zephyr-3b (#10643) 2024-04-03 16:28:31 +08:00
starcoder Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
yi Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
yuan2 Replace with IPEX-LLM in example comments (#10671) 2024-04-07 13:29:51 +08:00
README.md Update_document by heyang (#30) 2024-03-25 10:06:02 +08:00

README.md

IPEX-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.