ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update qlora README.md (#9422)

Browse source
This commit is contained in:
Ziteng Zhang 2023-11-10 15:19:25 +08:00 committed by GitHub
parent b23b91407c
commit ad81b5d838
1 changed files with 6 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
python/llm/example/CPU/QLoRA-FineTuning/README.md
View file

@ -20,7 +20,12 @@ pip install datasets
### 2. Finetune model ### 2. Finetune model
If the machine memory is not enough, you can try to set `use_gradient_checkpointing=True` in [here](https://github.com/intel-analytics/BigDL/blob/1747ffe60019567482b6976a24b05079274e7fc8/python/llm/example/CPU/QLoRA-FineTuning/qlora_finetuning_cpu.py#L53C6-L53C6).
And remember to use `bigdl-llm-init` before you start finetuning, which can accelerate the job.
``` ```
source bigdl-llm-init -t
python ./qlora_finetuning_cpu.py --repo-id-or-model-path REPO_ID_OR_MODEL_PATH --dataset DATASET python ./qlora_finetuning_cpu.py --repo-id-or-model-path REPO_ID_OR_MODEL_PATH --dataset DATASET
``` ```