ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/GPU/PyTorch-Models/Model
History
hxsz1997 245c7348bc
Add codegemma example (#10884) 
* add codegemma example in GPU/HF-Transformers-AutoModels/

* add README of codegemma example in GPU/HF-Transformers-AutoModels/

* add codegemma example in GPU/PyTorch-Models/

* add readme of codegemma example in GPU/PyTorch-Models/

* add codegemma example in CPU/HF-Transformers-AutoModels/

* add readme of codegemma example in CPU/HF-Transformers-AutoModels/

* add codegemma example in CPU/PyTorch-Models/

* add readme of codegemma example in CPU/PyTorch-Models/

* fix typos

* fix filename typo

* add codegemma in tables

* add comments of lm_head

* remove comments of use_cache
2024-05-07 13:35:42 +08:00
..
aquila2 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
baichuan GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
baichuan2 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
bark GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
bluelm GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
chatglm2 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
chatglm3 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
codegemma Add codegemma example (#10884) 2024-05-07 13:35:42 +08:00
codellama GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
deciLM-7b GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
deepseek GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
distil-whisper GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
dolly-v1 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
dolly-v2 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
flan-t5 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
internlm2 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
llama2 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
llama3 Fix the not stop issue of llama3 examples (#10860) 2024-04-23 19:10:09 +08:00
llava GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
mamba GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
mistral GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
mixtral GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
phi-1_5 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
phi-2 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
phi-3 Add example for phi-3 (#10881) 2024-04-29 16:43:55 +08:00
phixtral GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
qwen-vl GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
qwen1.5 LLM：Add qwen moe example libs md (#10828) 2024-04-22 10:03:19 +08:00
replit GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
solar GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
speech-t5 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
stablelm GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
starcoder GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
yi GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
yuan2 GPU configuration update for examples (windows pip installer, etc.) (#10762) 2024-04-15 17:42:52 +08:00
README.md Update_document by heyang (#30) 2024-03-25 10:06:02 +08:00

README.md

IPEX-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.