ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Fix typo in Baichuan2 example (#10589)

Browse source
This commit is contained in:
Keyan (Kyrie) Zhang 2024-03-28 22:31:47 -07:00 committed by GitHub
parent 52f1b541cf
commit 848fa04dd6
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
python/llm/example/GPU/PyTorch-Models/Model/baichuan2/generate.py
View file

@ -24,7 +24,7 @@ from ipex_llm import optimize_model
# prompt format referred from https://github.com/baichuan-inc/Baichuan2/issues/227
# and https://huggingface.co/baichuan-inc/Baichuan2-7B-Chat/blob/main/generation_utils.py#L7-L49
# For English prompt, you are recommended to change the prompt format.
BAICHUAN_PROMPT_FORMAT = "<reserved_106> {prompt} <reserved_107>"
BAICHUAN2_PROMPT_FORMAT = "<reserved_106> {prompt} <reserved_107>"
if __name__ == '__main__':
parser = argparse.ArgumentParser(description='Predict Tokens using `generate()` API for Baichuan2 model')