ayo/ipex-llm

History

Jin Qiao 10ee786920 Replace with IPEX-LLM in example comments (#10671 ) * Replace with IPEX-LLM in example comments * More replacement * revert some changes		2024-04-07 13:29:51 +08:00
..
common	Refactor bigdl.llm to ipex_llm (#24 )	2024-03-22 15:41:21 +08:00
DPO	Replace with IPEX-LLM in example comments (#10671 )	2024-04-07 13:29:51 +08:00
HF-PEFT	Replace with IPEX-LLM in example comments (#10671 )	2024-04-07 13:29:51 +08:00
LoRA	Replace with IPEX-LLM in example comments (#10671 )	2024-04-07 13:29:51 +08:00
QA-LoRA	Replace with IPEX-LLM in example comments (#10671 )	2024-04-07 13:29:51 +08:00
QLoRA	Replace with IPEX-LLM in example comments (#10671 )	2024-04-07 13:29:51 +08:00
ReLora	Replace with IPEX-LLM in example comments (#10671 )	2024-04-07 13:29:51 +08:00
README.md	Update_document by heyang (#30 )	2024-03-25 10:06:02 +08:00

README.md

Running LLM Finetuning using IPEX-LLM on Intel GPU

This folder contains examples of running different training mode with IPEX-LLM on Intel GPU:

LoRA: examples of running LoRA finetuning
QLoRA: examples of running QLoRA finetuning
QA-LoRA: examples of running QA-LoRA finetuning
ReLora: examples of running ReLora finetuning
DPO: examples of running DPO finetuning
common: common templates and utility classes in finetuning examples
HF-PEFT: run finetuning on Intel GPU using Hugging Face PEFT code without modification

Troubleshooting

If you fail to finetune on multi cards because of following error message:
```
RuntimeError: oneCCL: comm_selector.cpp:57 create_comm_impl: EXCEPTION: ze_data was not initialized
```
Please try sudo apt install level-zero-dev to fix it.
Please raise the system open file limit using ulimit -n 1048576. Otherwise, there may exist error Too many open files.