ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

exclude dolly-v2-12b for arc perf test (#11315)

Browse source 
* test arc perf

* test

* test

* exclude dolly-v2-12b:2048

* revert changes
This commit is contained in:
Shaojun Liu 2024-06-14 15:35:56 +08:00 committed by GitHub
parent 77809be946
commit f5ef94046e
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 3 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
python/llm/test/benchmark/arc-perf-test-batch2.yaml
View file

@ -9,7 +9,7 @@ repo_id:
- 'bigcode/starcoder-15.5b-4bit' - 'bigcode/starcoder-15.5b-4bit'
- 'databricks/dolly-v1-6b' - 'databricks/dolly-v1-6b'
- 'databricks/dolly-v2-7b' - 'databricks/dolly-v2-7b'
- 'databricks/dolly-v2-12b' # - 'databricks/dolly-v2-12b'
- 'internlm/internlm-chat-7b' - 'internlm/internlm-chat-7b'
- 'Qwen/Qwen-7B-Chat' - 'Qwen/Qwen-7B-Chat'
- 'BAAI/AquilaChat-7B' - 'BAAI/AquilaChat-7B'
@ -33,6 +33,6 @@ test_api:
cpu_embedding: False # whether put embedding to CPU (only avaiable now for gpu win related test_api) cpu_embedding: False # whether put embedding to CPU (only avaiable now for gpu win related test_api)
exclude: exclude:
- 'bigcode/starcoder-15.5b-4bit:2048' - 'bigcode/starcoder-15.5b-4bit:2048'
- 'databricks/dolly-v2-12b:2048' # - 'databricks/dolly-v2-12b:2048'
- 'baichuan-inc/Baichuan2-13B-Chat-4bit:2048' - 'baichuan-inc/Baichuan2-13B-Chat-4bit:2048'
- 'bigscience/bloomz-7b1:2048' - 'bigscience/bloomz-7b1:2048'

2
python/llm/test/benchmark/arc-perf-test.yaml
View file

@ -9,7 +9,7 @@ repo_id:
- 'bigcode/starcoder-15.5b-4bit' - 'bigcode/starcoder-15.5b-4bit'
- 'databricks/dolly-v1-6b' - 'databricks/dolly-v1-6b'
- 'databricks/dolly-v2-7b' - 'databricks/dolly-v2-7b'
- 'databricks/dolly-v2-12b' # - 'databricks/dolly-v2-12b'
- 'internlm/internlm-chat-7b' - 'internlm/internlm-chat-7b'
- 'Qwen/Qwen-7B-Chat' - 'Qwen/Qwen-7B-Chat'
- 'BAAI/AquilaChat-7B' - 'BAAI/AquilaChat-7B'