ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/GPU/LLM-Finetuning
History
Cheen Hau, 俊豪 1c5eb14128
Update pip install to use --extra-index-url for ipex package (#10557) 
* Change to 'pip install .. --extra-index-url' for readthedocs

* Change to 'pip install .. --extra-index-url' for examples

* Change to 'pip install .. --extra-index-url' for remaining files

* Fix URL for ipex

* Add links for ipex US and CN servers

* Update ipex cpu url

* remove readme

* Update for github actions

* Update for dockerfiles
2024-03-28 09:56:23 +08:00
..
common Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00
DPO Update pip install to use --extra-index-url for ipex package (#10557) 2024-03-28 09:56:23 +08:00
HF-PEFT Update pip install to use --extra-index-url for ipex package (#10557) 2024-03-28 09:56:23 +08:00
LoRA Update pip install to use --extra-index-url for ipex package (#10557) 2024-03-28 09:56:23 +08:00
QA-LoRA Update pip install to use --extra-index-url for ipex package (#10557) 2024-03-28 09:56:23 +08:00
QLoRA Update pip install to use --extra-index-url for ipex package (#10557) 2024-03-28 09:56:23 +08:00
ReLora Update pip install to use --extra-index-url for ipex package (#10557) 2024-03-28 09:56:23 +08:00
README.md Update_document by heyang (#30) 2024-03-25 10:06:02 +08:00

README.md

Running LLM Finetuning using IPEX-LLM on Intel GPU

This folder contains examples of running different training mode with IPEX-LLM on Intel GPU:

  • LoRA: examples of running LoRA finetuning
  • QLoRA: examples of running QLoRA finetuning
  • QA-LoRA: examples of running QA-LoRA finetuning
  • ReLora: examples of running ReLora finetuning
  • DPO: examples of running DPO finetuning
  • common: common templates and utility classes in finetuning examples
  • HF-PEFT: run finetuning on Intel GPU using Hugging Face PEFT code without modification

Troubleshooting

  • If you fail to finetune on multi cards because of following error message:

    RuntimeError: oneCCL: comm_selector.cpp:57 create_comm_impl: EXCEPTION: ze_data was not initialized

    Please try sudo apt install level-zero-dev to fix it.

  • Please raise the system open file limit using ulimit -n 1048576. Otherwise, there may exist error Too many open files.