ipex-llm/docker/llm/finetune/lora/docker
Heyang Sun b1ac8dc1bc BF16 Lora Finetuning on K8S with OneCCL and Intel MPI (#8775)
* BF16 Lora Finetuning on K8S with OneCCL and Intel MPI

* Update README.md

* format

* refine

* Update README.md

* refine

* Update README.md

* increase nfs volume size to improve IO performance

* fix bugs

* Update README.md

* Update README.md

* fix permission

* move output destination

* Update README.md

* fix wrong base model name in doc

* fix output path in entrypoint

* add a permission-precreated output dir

* format

* move output logs to a persistent storage
2023-08-31 14:56:23 +08:00
..
bigdl-lora-finetuing-entrypoint.sh BF16 Lora Finetuning on K8S with OneCCL and Intel MPI (#8775) 2023-08-31 14:56:23 +08:00
Dockerfile BF16 Lora Finetuning on K8S with OneCCL and Intel MPI (#8775) 2023-08-31 14:56:23 +08:00
lora_finetune.py BF16 Lora Finetuning on K8S with OneCCL and Intel MPI (#8775) 2023-08-31 14:56:23 +08:00
README.md BF16 Lora Finetuning on K8S with OneCCL and Intel MPI (#8775) 2023-08-31 14:56:23 +08:00
requirements.txt BF16 Lora Finetuning on K8S with OneCCL and Intel MPI (#8775) 2023-08-31 14:56:23 +08:00

Prepare BigDL image for Lora Finetuning

You can download directly from Dockerhub like:

docker pull intelanalytics/bigdl-lora-finetuning:2.4.0-SNAPSHOT

Or build the image from source:

export HTTP_PROXY=your_http_proxy
export HTTPS_PROXY=your_https_proxy

docker build \
  --build-arg HTTP_PROXY=${HTTP_PROXY} \
  --build-arg HTTPS_PROXY=${HTTPS_PROXY} \
  -t intelanalytics/bigdl-lora-finetuning:2.4.0-SNAPSHOT \
  -f ./Dockerfile .