9df70d95eb
* Rename bigdl/llm to ipex_llm * rm python/llm/src/bigdl * from bigdl.llm to from ipex_llm |
||
|---|---|---|
| .. | ||
| common | ||
| DPO | ||
| HF-PEFT | ||
| LoRA | ||
| QA-LoRA | ||
| QLoRA | ||
| ReLora | ||
| README.md | ||
Running LLM Finetuning using BigDL-LLM on Intel GPU
This folder contains examples of running different training mode with BigDL-LLM on Intel GPU:
- LoRA: examples of running LoRA finetuning
- QLoRA: examples of running QLoRA finetuning
- QA-LoRA: examples of running QA-LoRA finetuning
- ReLora: examples of running ReLora finetuning
- DPO: examples of running DPO finetuning
- common: common templates and utility classes in finetuning examples
- HF-PEFT: run finetuning on Intel GPU using Hugging Face PEFT code without modification
Troubleshooting
-
If you fail to finetune on multi cards because of following error message:
RuntimeError: oneCCL: comm_selector.cpp:57 create_comm_impl: EXCEPTION: ze_data was not initializedPlease try
sudo apt install level-zero-devto fix it. -
Please raise the system open file limit using
ulimit -n 1048576. Otherwise, there may exist errorToo many open files.