ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Add phi-3 to perf (#10883)

Browse source
This commit is contained in:
Jin Qiao 2024-04-25 20:21:56 +08:00 committed by GitHub
parent 8811f268ff
commit fb3c268d13
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
python/llm/test/benchmark/igpu-perf/1024-128_437.yaml
View file

@ -3,6 +3,7 @@ repo_id:
- 'meta-llama/Meta-Llama-3-8B-Instruct' - 'meta-llama/Meta-Llama-3-8B-Instruct'
- '01-ai/Yi-6B-Chat' - '01-ai/Yi-6B-Chat'
- 'microsoft/phi-2' - 'microsoft/phi-2'
- 'microsoft/Phi-3-mini-4k-instruct'
local_model_hub: 'path to your local model hub' local_model_hub: 'path to your local model hub'
warm_up: 1 warm_up: 1
num_trials: 3 num_trials: 3

1
python/llm/test/benchmark/igpu-perf/1024-128_loadlowbit_437.yaml
View file

@ -3,6 +3,7 @@ repo_id:
- 'meta-llama/Meta-Llama-3-8B-Instruct' - 'meta-llama/Meta-Llama-3-8B-Instruct'
- '01-ai/Yi-6B-Chat' - '01-ai/Yi-6B-Chat'
- 'microsoft/phi-2' - 'microsoft/phi-2'
- 'microsoft/Phi-3-mini-4k-instruct'
local_model_hub: 'path to your local model hub' local_model_hub: 'path to your local model hub'
warm_up: 1 warm_up: 1
num_trials: 3 num_trials: 3

1
python/llm/test/benchmark/igpu-perf/2048-256_437.yaml
View file

@ -3,6 +3,7 @@ repo_id:
- 'meta-llama/Meta-Llama-3-8B-Instruct' - 'meta-llama/Meta-Llama-3-8B-Instruct'
- '01-ai/Yi-6B-Chat' - '01-ai/Yi-6B-Chat'
- 'microsoft/phi-2' - 'microsoft/phi-2'
- 'microsoft/Phi-3-mini-4k-instruct'
local_model_hub: 'path to your local model hub' local_model_hub: 'path to your local model hub'
warm_up: 1 warm_up: 1
num_trials: 3 num_trials: 3

1
python/llm/test/benchmark/igpu-perf/32-32_437.yaml
View file

@ -3,6 +3,7 @@ repo_id:
- 'meta-llama/Meta-Llama-3-8B-Instruct' - 'meta-llama/Meta-Llama-3-8B-Instruct'
- '01-ai/Yi-6B-Chat' - '01-ai/Yi-6B-Chat'
- 'microsoft/phi-2' - 'microsoft/phi-2'
- 'microsoft/Phi-3-mini-4k-instruct'
local_model_hub: 'path to your local model hub' local_model_hub: 'path to your local model hub'
warm_up: 3 warm_up: 3
num_trials: 5 num_trials: 5