* BF16 Lora Finetuning on K8S with OneCCL and Intel MPI * Update README.md * format * refine * Update README.md * refine * Update README.md * increase nfs volume size to improve IO performance * fix bugs * Update README.md * Update README.md * fix permission * move output destination * Update README.md * fix wrong base model name in doc * fix output path in entrypoint * add a permission-precreated output dir * format * move output logs to a persistent storage |
||
|---|---|---|
| .. | ||
| bigdl-lora-finetuing-entrypoint.sh | ||
| Dockerfile | ||
| lora_finetune.py | ||
| README.md | ||
| requirements.txt | ||
Prepare BigDL image for Lora Finetuning
You can download directly from Dockerhub like:
docker pull intelanalytics/bigdl-lora-finetuning:2.4.0-SNAPSHOT
Or build the image from source:
export HTTP_PROXY=your_http_proxy
export HTTPS_PROXY=your_https_proxy
docker build \
--build-arg HTTP_PROXY=${HTTP_PROXY} \
--build-arg HTTPS_PROXY=${HTTPS_PROXY} \
-t intelanalytics/bigdl-lora-finetuning:2.4.0-SNAPSHOT \
-f ./Dockerfile .