ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

[LLM] Enable generation of html again for win igpu tests (#9652)

Browse source 
* Enable generation of html again and comment out rwkv for 32-512 as it is not very stable

* Small fix
This commit is contained in:
Yuwen Hu 2023-12-11 19:15:17 +08:00 committed by GitHub
parent afa895877c
commit d272b6dc47
2 changed files with 17 additions and 17 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

32
.github/workflows/llm_performance_tests.yml vendored
View file

@ -336,10 +336,10 @@ jobs:
cd python\llm\dev\benchmark\all-in-one cd python\llm\dev\benchmark\all-in-one
python ..\..\..\test\benchmark\concat_csv.py python ..\..\..\test\benchmark\concat_csv.py
move *.csv %CSV_SAVE_PATH%\32-32\ move *.csv %CSV_SAVE_PATH%\32-32\
REM cd ..\..\..\test\benchmark cd ..\..\..\test\benchmark
REM python csv_to_html.py -f %CSV_SAVE_PATH%\32-32\ python csv_to_html.py -f %CSV_SAVE_PATH%\32-32\
REM if %ERRORLEVEL% neq 0 (exit /b 1) if %ERRORLEVEL% neq 0 (exit /b 1)
REM move *.csv %CSV_SAVE_PATH% move *.csv %CSV_SAVE_PATH%
call conda deactivate call conda deactivate
@ -404,10 +404,10 @@ jobs:
cd python\llm\dev\benchmark\all-in-one cd python\llm\dev\benchmark\all-in-one
python ..\..\..\test\benchmark\concat_csv.py python ..\..\..\test\benchmark\concat_csv.py
move *.csv %CSV_SAVE_PATH%\32-256\ move *.csv %CSV_SAVE_PATH%\32-256\
REM cd ..\..\..\test\benchmark cd ..\..\..\test\benchmark
REM python csv_to_html.py -f %CSV_SAVE_PATH%\32-256\ python csv_to_html.py -f %CSV_SAVE_PATH%\32-256\
REM if %ERRORLEVEL% neq 0 (exit /b 1) if %ERRORLEVEL% neq 0 (exit /b 1)
REM move *.csv %CSV_SAVE_PATH% move *.csv %CSV_SAVE_PATH%
call conda deactivate call conda deactivate
@ -472,10 +472,10 @@ jobs:
cd python\llm\dev\benchmark\all-in-one cd python\llm\dev\benchmark\all-in-one
python ..\..\..\test\benchmark\concat_csv.py python ..\..\..\test\benchmark\concat_csv.py
move *.csv %CSV_SAVE_PATH%\32-512\ move *.csv %CSV_SAVE_PATH%\32-512\
REM cd ..\..\..\test\benchmark cd ..\..\..\test\benchmark
REM python csv_to_html.py -f %CSV_SAVE_PATH%\32-512\ python csv_to_html.py -f %CSV_SAVE_PATH%\32-512\
REM if %ERRORLEVEL% neq 0 (exit /b 1) if %ERRORLEVEL% neq 0 (exit /b 1)
REM move *.csv %CSV_SAVE_PATH% move *.csv %CSV_SAVE_PATH%
call conda deactivate call conda deactivate
@ -514,10 +514,10 @@ jobs:
cd python\llm\dev\benchmark\all-in-one cd python\llm\dev\benchmark\all-in-one
move *.csv %CSV_SAVE_PATH%\512-64\ move *.csv %CSV_SAVE_PATH%\512-64\
REM cd ..\..\..\test\benchmark cd ..\..\..\test\benchmark
REM python csv_to_html.py -f %CSV_SAVE_PATH%\512-64\ python csv_to_html.py -f %CSV_SAVE_PATH%\512-64\
REM if %ERRORLEVEL% neq 0 (exit /b 1) if %ERRORLEVEL% neq 0 (exit /b 1)
REM move *.csv %CSV_SAVE_PATH% move *.csv %CSV_SAVE_PATH%
call conda deactivate call conda deactivate

2
python/llm/test/benchmark/igpu-perf/32-512.yaml
View file

@ -11,7 +11,7 @@ repo_id:
- 'tiiuae/falcon-7b-instruct-with-patch' - 'tiiuae/falcon-7b-instruct-with-patch'
- 'mosaicml/mpt-7b-chat' - 'mosaicml/mpt-7b-chat'
- 'liuhaotian/llava-v1.5-7b' - 'liuhaotian/llava-v1.5-7b'
- 'RWKV/rwkv-4-world-7b' # - 'RWKV/rwkv-4-world-7b'
local_model_hub: 'path to your local model hub' local_model_hub: 'path to your local model hub'
warm_up: 1 warm_up: 1
num_trials: 3 num_trials: 3