ipex-llm/python/llm/example/GPU/LLM-Finetuning/QLoRA
Wang, Jian4 9df70d95eb
Refactor bigdl.llm to ipex_llm (#24)
* Rename bigdl/llm to ipex_llm

* rm python/llm/src/bigdl

* from bigdl.llm to from ipex_llm
2024-03-22 15:41:21 +08:00
..
alpaca-qlora Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
simple-example Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
trl-example Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
README.md LLM: add qlora finetuning example using trl.SFTTrainer (#10183) 2024-02-21 16:40:04 +08:00

QLoRA Finetuning with BigDL-LLM

We provide Alpaca-QLoRA example, which ports Alpaca-LoRA to BigDL-LLM (using QLoRA algorithm) on Intel GPU.

Meanwhile, we also provide a simple example to help you get started with QLoRA Finetuning using BigDL-LLM, and TRL example to help you get started with QLoRA Finetuning using BigDL-LLM and TRL library.