ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update threshold for cpu stable version tests (#10108)

Browse source 
* update threshold

* update

* test

* update

* update

* revert

* revert

---------

Co-authored-by: Your Name <Your Email>
This commit is contained in:
Shaojun Liu 2024-02-07 11:21:23 +08:00 committed by GitHub
parent 63050c954d
commit 5e9710cec4
1 changed files with 10 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

12
.github/workflows/llm_tests_for_stable_version_on_spr.yml vendored
View file

@ -72,8 +72,12 @@ jobs:
cp ./*.csv /models/stable_version_perf_regression_test_cpu/
cd ../../../test/benchmark
python -m pip install pandas==1.5.3
python csv_to_html.py -f /models/stable_version_perf_regression_test_cpu/ -b /models/stable_version_perf_regression_test_cpu/transformer_int4-results-1baseline.csv -t 5.0
python csv_to_html.py -f /models/stable_version_perf_regression_test_cpu/ -b /models/stable_version_perf_regression_test_cpu/transformer_int4-results-1baseline.csv -t 10.0
cd /models/stable_version_perf_regression_test_cpu/
for f in *.html; do
curl -T "$f" ${LLM_FTP_URL}/llm/nightly_perf/stable_version_cpu/regression_test/
done
llm-stress-test-on-spr:
needs: llm-perf-regression-test-on-spr
@ -127,3 +131,7 @@ jobs:
cd ../../../test/benchmark
python -m pip install pandas==1.5.3
python csv_to_html.py -f /models/stable_version_stress_test_cpu/
# cd /models/stable_version_stress_test_cpu/
# for f in *.html; do
# curl -T "$f" ${LLM_FTP_URL}/llm/nightly_perf/stable_version_cpu/stress_test/
# done