ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/GPU/LLM-Finetuning
History
binbin Deng 7e49fbc5dd LLM: make finetuning examples more common for other models (#10078)
2024-02-04 16:03:52 +08:00
..
common LLM: reorganize GPU finetuning examples (#9952) 2024-01-25 19:02:38 +08:00
DPO LLM: Add initial DPO finetuning example (#10021) 2024-02-01 14:18:08 +08:00
LoRA LLM: make finetuning examples more common for other models (#10078) 2024-02-04 16:03:52 +08:00
QA-LoRA LLM: make finetuning examples more common for other models (#10078) 2024-02-04 16:03:52 +08:00
QLoRA LLM: make finetuning examples more common for other models (#10078) 2024-02-04 16:03:52 +08:00
ReLora LLM: make finetuning examples more common for other models (#10078) 2024-02-04 16:03:52 +08:00
README.md LLM: Add initial DPO finetuning example (#10021) 2024-02-01 14:18:08 +08:00

README.md

Running LLM Finetuning using BigDL-LLM on Intel GPU

This folder contains examples of running different training mode with BigDL-LLM on Intel GPU:

  • LoRA: examples of running LoRA finetuning
  • QLoRA: examples of running QLoRA finetuning
  • QA-LoRA: examples of running QA-LoRA finetuning
  • ReLora: examples of running ReLora finetuning
  • DPO: examples of running DPO finetuning
  • common: common templates and utility classes in finetuning examples