ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Disable fast_init_ in load_low_bit (#10945)

Browse source 
* fast_init_ disable
This commit is contained in:
Zhao Changmin 2024-05-08 10:46:19 +08:00 committed by GitHub
parent 164e6957af
commit 0d6e12036f
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
python/llm/src/ipex_llm/transformers/model.py
View file

@ -673,7 +673,7 @@ class _BaseAutoModelClass:
resolved_archive_file, resolved_archive_file,
pretrained_model_name_or_path, pretrained_model_name_or_path,
sharded_metadata=sharded_metadata, sharded_metadata=sharded_metadata,
_fast_init=_fast_init, _fast_init=False, # always false to avoid pre-init behaviors
low_cpu_mem_usage=bigdl_lcmu_enabled, low_cpu_mem_usage=bigdl_lcmu_enabled,
offload_folder=offload_folder, offload_folder=offload_folder,
offload_state_dict=offload_state_dict, offload_state_dict=offload_state_dict,