ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

update pp document (#11421)

Browse source
This commit is contained in:
SONG Ge 2024-06-25 10:17:20 +08:00 committed by GitHub
parent 9e4ee61737
commit 34c15d3a10
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
python/llm/example/GPU/Pipeline-Parallel-Inference/README.md
View file

@ -59,6 +59,7 @@ For optimal performance, it is recommended to set several environment variables.
You could specify `--repo-id-or-model-path` in the test script to be the huggingface repo id for Llama2 / Llama3 to be downloaded, or the path to the huggingface checkpoint folder. Besides, you could change `NUM_GPUS` to the number of GPUs you have on your machine. You could specify `--repo-id-or-model-path` in the test script to be the huggingface repo id for Llama2 / Llama3 to be downloaded, or the path to the huggingface checkpoint folder. Besides, you could change `NUM_GPUS` to the number of GPUs you have on your machine.
```bash ```bash
pip install transformers==4.37.0
bash run_llama_arc_2_card.sh bash run_llama_arc_2_card.sh
``` ```
@ -167,6 +168,7 @@ bash run_yi_arc_2_card.sh
You could specify `--repo-id-or-model-path` in the test script to be the huggingface repo id for Codellama to be downloaded, or the path to the huggingface checkpoint folder. Besides, you could change `NUM_GPUS` to the number of GPUs you have on your machine. You could specify `--repo-id-or-model-path` in the test script to be the huggingface repo id for Codellama to be downloaded, or the path to the huggingface checkpoint folder. Besides, you could change `NUM_GPUS` to the number of GPUs you have on your machine.
```bash ```bash
pip install transformers==4.37.0
bash run_codellama_arc_2_card.sh bash run_codellama_arc_2_card.sh
``` ```
@ -182,6 +184,7 @@ bash run_codellama_arc_2_card.sh
You could specify `--repo-id-or-model-path` in the test script to be the huggingface repo id for Solar to be downloaded, or the path to the huggingface checkpoint folder. Besides, you could change `NUM_GPUS` to the number of GPUs you have on your machine. You could specify `--repo-id-or-model-path` in the test script to be the huggingface repo id for Solar to be downloaded, or the path to the huggingface checkpoint folder. Besides, you could change `NUM_GPUS` to the number of GPUs you have on your machine.
```bash ```bash
pip install transformers==4.37.0
bash run_solar_arc_2_card.sh bash run_solar_arc_2_card.sh
``` ```