ipex-llm/python/llm/example/GPU/LLM-Finetuning/QLoRA
Ziteng Zhang 7d3791c819
[LLM] Add llama3 alpaca qlora example (#11011)
* Add llama3 finetune example based on alpaca qlora example
2024-05-15 09:17:32 +08:00
..
alpaca-qlora [LLM] Add llama3 alpaca qlora example (#11011) 2024-05-15 09:17:32 +08:00
simple-example Upgrade Peft to 0.10.0 in finetune examples and docker (#10930) 2024-05-07 15:12:26 +08:00
trl-example Upgrade Peft to 0.10.0 in finetune examples and docker (#10930) 2024-05-07 15:12:26 +08:00
README.md Update_document by heyang (#30) 2024-03-25 10:06:02 +08:00

QLoRA Finetuning with IPEX-LLM

We provide Alpaca-QLoRA example, which ports Alpaca-LoRA to IPEX-LLM (using QLoRA algorithm) on Intel GPU.

Meanwhile, we also provide a simple example to help you get started with QLoRA Finetuning using IPEX-LLM, and TRL example to help you get started with QLoRA Finetuning using IPEX-LLM and TRL library.