ipex-llm/python/llm/example/GPU/HF-Transformers-AutoModels/Model
Zijie Li bfa1367149
Add CPU and GPU example for MiniCPM (#11202)
* Change installation address

Change former address: "https://docs.conda.io/en/latest/miniconda.html#" to new address: "https://conda-forge.org/download/" for 63 occurrences under python\llm\example

* Change Prompt

Change "Anaconda Prompt" to "Miniforge Prompt" for 1 occurrence

* Create and update model minicpm

* Update model minicpm

Update model minicpm under GPU/PyTorch-Models

* Update readme and generate.py

change "prompt = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=False)" and delete "pip install transformers==4.37.0
"

* Update comments for minicpm GPU

Update comments for generate.py at minicpm GPU

* Add CPU example for MiniCPM

* Update minicpm README for CPU

* Update README for MiniCPM and Llama3

* Update Readme for Llama3 CPU Pytorch

* Update and fix comments for MiniCPM
2024-06-05 18:09:53 +08:00
..
aquila Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
aquila2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
baichuan Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
baichuan2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
bluelm Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
chatglm2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
chatglm3 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
chinese-llama2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
codegeex2 LLM: Add codegeex2 example (#11143) 2024-05-29 10:00:26 +08:00
codegemma Miniconda/Anaconda -> Miniforge update in examples (#11194) 2024-06-04 10:14:02 +08:00
codellama Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
codeshell Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
cohere LLM: Modify CPU Installation Command for most examples (#11049) 2024-05-17 15:52:20 +08:00
deciLM-7b Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
deepseek Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
distil-whisper Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
dolly-v1 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
dolly-v2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
falcon Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
flan-t5 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
gemma Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
gpt-j Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
internlm Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
internlm2 Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
llama2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
llama3 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
minicpm Add CPU and GPU example for MiniCPM (#11202) 2024-06-05 18:09:53 +08:00
mistral Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
mixtral Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
mpt LLM: Modify CPU Installation Command for most examples (#11049) 2024-05-17 15:52:20 +08:00
phi-1_5 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
phi-2 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
phi-3 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
phi-3-vision Add phi-3-vision example (#11156) 2024-05-30 10:02:47 +08:00
phixtral Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
qwen Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
qwen-vl Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
qwen1.5 Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
redpajama Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
replit Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
rwkv4 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
rwkv5 Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
solar Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
stablelm Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
starcoder Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
vicuna Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
voiceassistant Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
whisper Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
yi Remove oneAPI pip install command in related examples (#11030) 2024-05-16 10:46:29 +08:00
yuan2 Fix IPEX auto importer (#11192) 2024-06-04 16:57:18 +08:00
README.md Update_document by heyang (#30) 2024-03-25 10:06:02 +08:00

IPEX-LLM Transformers INT4 Optimization for Large Language Model on Intel GPUs

You can use IPEX-LLM to run almost every Huggingface Transformer models with INT4 optimizations on your laptops with Intel GPUs. This directory contains example scripts to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Each model has its own dedicated folder, where you can find detailed instructions on how to install and run it.