ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/GPU/HF-Transformers-AutoModels
History
hxsz1997 245c7348bc
Add codegemma example (#10884) 
* add codegemma example in GPU/HF-Transformers-AutoModels/

* add README of codegemma example in GPU/HF-Transformers-AutoModels/

* add codegemma example in GPU/PyTorch-Models/

* add readme of codegemma example in GPU/PyTorch-Models/

* add codegemma example in CPU/HF-Transformers-AutoModels/

* add readme of codegemma example in CPU/HF-Transformers-AutoModels/

* add codegemma example in CPU/PyTorch-Models/

* add readme of codegemma example in CPU/PyTorch-Models/

* fix typos

* fix filename typo

* add codegemma in tables

* add comments of lm_head

* remove comments of use_cache
2024-05-07 13:35:42 +08:00
..
Advanced-Quantizations Support the desc_act feature in GPTQ model (#10851) 2024-04-24 10:17:13 -07:00
Model Add codegemma example (#10884) 2024-05-07 13:35:42 +08:00
More-Data-Types Upgrade to python 3.11 (#10711) 2024-04-09 17:41:17 +08:00
Save-Load Upgrade to python 3.11 (#10711) 2024-04-09 17:41:17 +08:00
README.md Update readme (#10665) 2024-04-05 18:01:57 +08:00

README.md

Running HuggingFace transformers model using IPEX-LLM on Intel GPU

This folder contains examples of running any HuggingFace transformers model on IPEX-LLM (using the standard AutoModel APIs):

  • Model: examples of running HuggingFace transformers models (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) using INT4 optimizations
  • More-Data-Types: examples of applying other low bit optimizations (FP8/INT8/FP4, etc.)
  • Save-Load: examples of saving and loading low-bit models
  • Advanced-Quantizations: examples of loading GGUF/AWQ/GPTQ models