ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

fix typos in qlora README (#10893)

Browse source
This commit is contained in:
Heyang Sun 2024-04-26 14:03:06 +08:00 committed by GitHub
parent 3d4950b0f0
commit 751f6d11d8
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 5 additions and 5 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
docker/llm/finetune/qlora/xpu/docker/README.md
View file

@ -37,13 +37,13 @@ docker run -itd \
--net=host \
--device=/dev/dri \
--memory="32G" \
--name=ipex-llm-fintune-qlora-xpu \
--name=ipex-llm-finetune-qlora-xpu \
-e http_proxy=${HTTP_PROXY} \
-e https_proxy=${HTTPS_PROXY} \
-v $BASE_MODE_PATH:/model \
-v $DATA_PATH:/data/alpaca-cleaned \
--shm-size="16g" \
intelanalytics/ipex-llm-fintune-qlora-xpu:2.1.0-SNAPSHOT
intelanalytics/ipex-llm-finetune-qlora-xpu:2.1.0-SNAPSHOT
```
The download and mount of base model and data to a docker container demonstrates a standard fine-tuning process. You can skip this step for a quick start, and in this way, the fine-tuning codes will automatically download the needed files:
@ -56,11 +56,11 @@ docker run -itd \
--net=host \
--device=/dev/dri \
--memory="32G" \
--name=ipex-llm-fintune-qlora-xpu \
--name=ipex-llm-finetune-qlora-xpu \
-e http_proxy=${HTTP_PROXY} \
-e https_proxy=${HTTPS_PROXY} \
--shm-size="16g" \
intelanalytics/ipex-llm-fintune-qlora-xpu:2.1.0-SNAPSHOT
intelanalytics/ipex-llm-finetune-qlora-xpu:2.1.0-SNAPSHOT
```
However, we do recommend you to handle them manually, because the automatical download can be blocked by Internet access and Huggingface authentication etc. according to different environment, and the manual method allows you to fine-tune in a custom way (with different base model and dataset).
@ -70,7 +70,7 @@ However, we do recommend you to handle them manually, because the automatical do
Enter the running container:
```bash
docker exec -it ipex-llm-fintune-qlora-xpu bash
docker exec -it ipex-llm-finetune-qlora-xpu bash
```
Then, start QLoRA fine-tuning: