ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

LLM: Fix vLLM CPU convert error (#11926)

Browse source
This commit is contained in:
Xiangyu Tian 2024-08-27 09:22:19 +08:00 committed by GitHub
parent 5a8fc1baa2
commit 7ca557aada
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
python/llm/src/ipex_llm/vllm/cpu/model_convert.py
View file

@ -254,8 +254,8 @@ def get_load_function(low_bit):
scheduler_config=self.scheduler_config) scheduler_config=self.scheduler_config)
return return
_model_mlp_convert() # _model_mlp_convert()
_model_attention_convert() # _model_attention_convert()
self.model = get_model( self.model = get_model(
model_config=self.model_config, model_config=self.model_config,