ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

make gemma's output better (#10943)

Browse source
This commit is contained in:
Xin Qiu 2024-05-08 14:27:51 +08:00 committed by GitHub
parent 15ee3fd542
commit 5973d6c753
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
python/llm/example/GPU/HF-Transformers-AutoModels/Model/gemma/generate.py
View file

@ -48,6 +48,7 @@ if __name__ == '__main__':
load_in_4bit=True, load_in_4bit=True,
optimize_model=True, optimize_model=True,
trust_remote_code=True, trust_remote_code=True,
mixed_precision=True,
use_cache=True) use_cache=True)
model = model.to('xpu') model = model.to('xpu')