ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Fix fp6k phi3 ppl core dump (#11204)

Browse source
This commit is contained in:
Yina Chen 2024-06-04 16:44:27 +08:00 committed by GitHub
parent f02f097002
commit 711fa0199e
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
python/llm/dev/benchmark/perplexity/run_wikitext.py
View file

@ -44,6 +44,7 @@ else: # ipex-llm
use_cache=args.use_cache, trust_remote_code=True) use_cache=args.use_cache, trust_remote_code=True)
model = model.half() model = model.half()
model = model.to(args.device) model = model.to(args.device)
model = model.eval()
with open(args.data_path, "rb") as f: with open(args.data_path, "rb") as f:
data = f.read() data = f.read()