ipex-llm/python/llm/example/GPU/LLM-Finetuning/QLoRA
Qiyuan Gong d7ca5d935b
Upgrade Peft version to 0.10.0 for LLM finetune (#10886)
* Upgrade Peft version to 0.10.0
* Upgrade Peft version in ARC unit test and HF-Peft example.
2024-05-07 15:09:14 +08:00
..
alpaca-qlora Upgrade Peft version to 0.10.0 for LLM finetune (#10886) 2024-05-07 15:09:14 +08:00
simple-example Upgrade to python 3.11 (#10711) 2024-04-09 17:41:17 +08:00
trl-example Upgrade to python 3.11 (#10711) 2024-04-09 17:41:17 +08:00
README.md Update_document by heyang (#30) 2024-03-25 10:06:02 +08:00

QLoRA Finetuning with IPEX-LLM

We provide Alpaca-QLoRA example, which ports Alpaca-LoRA to IPEX-LLM (using QLoRA algorithm) on Intel GPU.

Meanwhile, we also provide a simple example to help you get started with QLoRA Finetuning using IPEX-LLM, and TRL example to help you get started with QLoRA Finetuning using IPEX-LLM and TRL library.