ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/GPU/PyTorch-Models/Model
History
Mingyu Wei bc9cff51a8 LLM GPU Example Update for Windows Support (#9902) 
* Update README in LLM GPU Examples

* Update reference of Intel GPU

* add cpu_embedding=True in comment

* small fixes

* update GPU/README.md and add explanation for cpu_embedding=True

* address comments

* fix small typos

* add backtick for cpu_embedding=True

* remove extra backtick in the doc

* add period mark

* update readme
2024-01-24 13:42:27 +08:00
..
aquila2 LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
baichuan LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
baichuan2 LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
bluelm LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
chatglm2 LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
chatglm3 LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
codellama LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
distil-whisper LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
dolly-v1 LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
dolly-v2 LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
flan-t5 LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
llama2 LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
llava LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
mistral LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
mixtral LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
phi-1_5 LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
qwen-vl LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
replit LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
solar LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
starcoder LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
yi LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00
README.md LLM GPU Example Update for Windows Support (#9902) 2024-01-24 13:42:27 +08:00

README.md

BigDL-LLM INT4 Optimization for Large Language Model on Intel GPUs

You can use optimize_model API to accelerate general PyTorch models on Intel GPUs. This directory contains example scripts to help you quickly get started using BigDL-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.