History

Jinyi Wan ec2d9de0ea Fix README.md for solar (#9957 )		2024-01-24 15:50:54 +08:00
..
aquila	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
aquila2	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
baichuan	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
baichuan2	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
bluelm	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
chatglm2	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
chatglm3	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
chinese-llama2	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
codellama	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
codeshell	add codeshell example (#9743 )	2023-12-25 10:54:01 +08:00
distil-whisper	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
dolly-v1	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
dolly-v2	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
falcon	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
flan-t5	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
gpt-j	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
internlm	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
llama2	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
mistral	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
mixtral	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
mpt	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
phi-1_5	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
qwen	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
qwen-vl	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
replit	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
solar	Fix README.md for solar (#9957 )	2024-01-24 15:50:54 +08:00
starcoder	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
vicuna	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
voiceassistant	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
whisper	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
yi	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00
README.md	LLM GPU Example Update for Windows Support (#9902 )	2024-01-24 13:42:27 +08:00

README.md

BigDL-LLM Transformers INT4 Optimization for Large Language Model on Intel GPUs

You can use BigDL-LLM to run almost every Huggingface Transformer models with INT4 optimizations on your laptops with Intel GPUs. This directory contains example scripts to help you quickly get started using BigDL-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.