ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/GPU/LLM-Finetuning/QLoRA
History
Heyang Sun 70c828b87c
deepspeed zero3 QLoRA finetuning (#11625) 
* deepspeed zero3 QLoRA finetuning

* Update convert.py

* Update low_bit_linear.py

* Update utils.py

* Update qlora_finetune_llama2_13b_arch_2_card.sh

* Update low_bit_linear.py

* Update alpaca_qlora_finetuning.py

* Update low_bit_linear.py

* Update utils.py

* Update convert.py

* Update alpaca_qlora_finetuning.py

* Update alpaca_qlora_finetuning.py

* Update low_bit_linear.py

* Update deepspeed_zero3.json

* Update qlora_finetune_llama2_13b_arch_2_card.sh

* Update low_bit_linear.py

* Update low_bit_linear.py

* Update utils.py

* fix style

* fix style

* Update alpaca_qlora_finetuning.py

* Update qlora_finetune_llama2_13b_arch_2_card.sh

* Update convert.py

* Update low_bit_linear.py

* Update model.py

* Update alpaca_qlora_finetuning.py

* Update low_bit_linear.py

* Update low_bit_linear.py

* Update low_bit_linear.py
2024-08-13 16:15:29 +08:00
..
alpaca-qlora deepspeed zero3 QLoRA finetuning (#11625) 2024-08-13 16:15:29 +08:00
simple-example Remove accelerate 0.23.0 install command in readme and docker (#11333) 2024-06-17 17:52:12 +08:00
trl-example Remove accelerate 0.23.0 install command in readme and docker (#11333) 2024-06-17 17:52:12 +08:00
README.md Update_document by heyang (#30) 2024-03-25 10:06:02 +08:00

README.md

QLoRA Finetuning with IPEX-LLM

We provide Alpaca-QLoRA example, which ports Alpaca-LoRA to IPEX-LLM (using QLoRA algorithm) on Intel GPU.

Meanwhile, we also provide a simple example to help you get started with QLoRA Finetuning using IPEX-LLM, and TRL example to help you get started with QLoRA Finetuning using IPEX-LLM and TRL library.