ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Add Deepspeed LoRA dependencies in document (#11410)

Browse source
This commit is contained in:
Heyang Sun 2024-06-24 15:29:59 +08:00 committed by GitHub
parent abe53eaa4f
commit c985912ee3
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 6 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
python/llm/example/GPU/LLM-Finetuning/LoRA/README.md
View file

@ -36,6 +36,12 @@ bash lora_finetune_llama2_7b_arc_1_card.sh
##### Finetuning ChatGLM3-6B on two Arc A770 ##### Finetuning ChatGLM3-6B on two Arc A770
```bash ```bash
# install deepspeed dependencies
source /opt/intel/oneapi/setvars.sh # necessary to run before installing deepspeed
pip install git+https://github.com/microsoft/DeepSpeed.git@78c518e
pip install git+https://github.com/intel/intel-extension-for-deepspeed.git@ec33277
#start finetuning
bash lora_deepspeed_zero3_finetune_chatglm3_6b_arc_2_card.sh bash lora_deepspeed_zero3_finetune_chatglm3_6b_arc_2_card.sh
``` ```