ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Add benchmark util for transformers 4.42 (#11725)

Browse source 
* add new benchmark_util.py

Add new benchmark_util.py for transformers>=4.43.1. The old one renamed to benchmark_util_prev.py.

* Small fix to import code

* Update __init__.py

* fix file names

* Update lint-python

Update lint-python to exclude benchmark_util_4_29.py
benchmark_util_4_43.py

* Update benchmark_util_4_43.py

* add benchmark_util for transformers 4.42
This commit is contained in:
Zijie Li 2024-08-07 08:48:07 +08:00 committed by GitHub
parent 4676af2054
commit e7f7141781
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
3 changed files with 4266 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
python/llm/dev/test/lint-python
View file

@ -21,7 +21,7 @@ SCRIPT_DIR="$( cd "$( dirname "$0" )" && pwd )"
PYTHON_ROOT_DIR="$SCRIPT_DIR/.."
echo $PYTHON_ROOT_DIR
PATHS_TO_CHECK="$SCRIPT_DIR/../../src"
PATTERNS_TO_EXCLUDE="__init__.py,log4Error.py,$SCRIPT_DIR/../../src/ipex_llm/langchain/*,$SCRIPT_DIR/../../src/ipex_llm/transformers/gguf/models/model_implement/yuan2/*,benchmark_util_4_29.py,benchmark_util_4_43.py,tgi_api_server.py"
PATTERNS_TO_EXCLUDE="__init__.py,log4Error.py,$SCRIPT_DIR/../../src/ipex_llm/langchain/*,$SCRIPT_DIR/../../src/ipex_llm/transformers/gguf/models/model_implement/yuan2/*,benchmark_util_4_29.py,benchmark_util_4_42.py,benchmark_util_4_43.py,tgi_api_server.py"
PEP8_REPORT_PATH="$PYTHON_ROOT_DIR/test/pep8-report.txt"
PYLINT_REPORT_PATH="$PYTHON_ROOT_DIR/test/pylint-report.txt"
PYLINT_INSTALL_INFO="$PYTHON_ROOT_DIR/test/pylint-info.txt"

4
python/llm/src/ipex_llm/utils/__init__.py
View file

@ -22,7 +22,9 @@ import transformers
trans_version = transformers.__version__
if trans_version >= "4.43.1":
if trans_version >= "4.43.0":
from .benchmark_util_4_43 import BenchmarkWrapper
elif trans_version >= "4.42.0":
from .benchmark_util_4_42 import BenchmarkWrapper
else:
from .benchmark_util_4_29 import BenchmarkWrapper

4262
python/llm/src/ipex_llm/utils/benchmark_util_4_42.py Normal file
View file

File diff suppressed because it is too large Load diff