ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Small fix for Nonetype error (#10104)

Browse source
This commit is contained in:
Yuwen Hu 2024-02-06 14:58:52 +08:00 committed by GitHub
parent d61f4905ac
commit 518ef95abc
1 changed files with 2 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
python/llm/src/bigdl/llm/transformers/model.py
View file

@ -376,7 +376,8 @@ class _BaseAutoModelClass:
# enable tie_word_embeddings for MPT # enable tie_word_embeddings for MPT
# refer to https://huggingface.co/mosaicml/mpt-7b-chat/blob/main/modeling_mpt.py#L232 # refer to https://huggingface.co/mosaicml/mpt-7b-chat/blob/main/modeling_mpt.py#L232
if model.config.architectures[0] != 'MPTForCausalLM': if model.config.architectures is None \
or model.config.architectures[0] != 'MPTForCausalLM':
model.config.update({"tie_word_embeddings": False}) model.config.update({"tie_word_embeddings": False})
# add save_low_bit to pretrained model dynamically # add save_low_bit to pretrained model dynamically