History

yb-peng f1f4094a09 Add CPU and GPU examples of phi-2 (#10014 ) * Add CPU and GPU examples of phi-2 * In GPU hf example, updated the readme for Windows GPU supports * In GPU torch example, updated the readme for Windows GPU supports * update the table in BigDL/README.md * update the table in BigDL/python/llm/README.md		2024-02-23 14:05:53 +08:00
..
aquila	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
aquila2	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
baichuan	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
baichuan2	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
bluelm	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
chatglm2	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
chatglm3	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
chinese-llama2	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
codellama	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
codeshell	add codeshell example (#9743 )	2023-12-25 10:54:01 +08:00
distil-whisper	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
dolly-v1	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
dolly-v2	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
falcon	falcon for transformers 4.36 (#9960 )	2024-02-22 17:04:40 -08:00
flan-t5	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
gpt-j	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
internlm	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
internlm2	Add HF and PyTorch example InternLM2 (#10061 )	2024-02-04 10:25:55 +08:00
llama2	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
mistral	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
mixtral	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
mpt	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
phi-1_5	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
phi-2	Add CPU and GPU examples of phi-2 (#10014 )	2024-02-23 14:05:53 +08:00
phixtral	add phixtral and optimize phi-moe (#10052 )	2024-02-05 11:12:47 +08:00
qwen	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
qwen-vl	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
qwen1.5	Add Qwen1.5-7B-Chat (#10113 )	2024-02-21 13:29:29 +08:00
redpajama	LLM: modify the GPU example for redpajama model (#10044 )	2024-01-31 14:32:08 +08:00
replit	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
rwkv4	[LLM] Add RWKV4 HF GPU Example (#10105 )	2024-02-06 16:30:24 +08:00
rwkv5	LLM: add rwkv5 eagle GPU HF example (#10122 )	2024-02-07 16:58:29 +08:00
solar	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
starcoder	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
vicuna	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
voiceassistant	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
whisper	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
yi	LLM: GPU Example Updates for Windows (#9992 )	2024-01-29 11:25:11 +08:00
README.md	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00

README.md

BigDL-LLM Transformers INT4 Optimization for Large Language Model on Intel GPUs

You can use BigDL-LLM to run almost every Huggingface Transformer models with INT4 optimizations on your laptops with Intel GPUs. This directory contains example scripts to help you quickly get started using BigDL-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.