ipex-llm/python/llm/example/GPU/PyTorch-Models/Model
Jin Qiao 73a67804a4
GPU configuration update for examples (windows pip installer, etc.) (#10762)
* renew chatglm3-6b gpu example readme

fix

fix

fix

* fix for comments

* fix

* fix

* fix

* fix

* fix

* apply on HF-Transformers-AutoModels

* apply on PyTorch-Models

* fix

* fix
2024-04-15 17:42:52 +08:00
..
aquila2
baichuan
baichuan2
bark
bluelm
chatglm2
chatglm3
codellama
deciLM-7b
deepseek
distil-whisper
dolly-v1
dolly-v2
flan-t5
internlm2
llama2
llava
mamba
mistral
mixtral
phi-1_5
phi-2
phixtral
qwen-vl
qwen1.5
replit
solar
speech-t5
stablelm
starcoder
yi
yuan2
README.md

IPEX-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.