ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

[LLM] README revise for llm_convert (#8374)

Browse source 
* Small readme revise for llm_convert

* Small fix
This commit is contained in:
Yuwen Hu 2023-06-21 10:04:34 +08:00 committed by GitHub
parent 7ef1c890eb
commit a7d66b7342
1 changed files with 2 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
python/llm/README.md
View file

@ -52,10 +52,9 @@ llm_convert(model="/path/to/llama-7b-hf/",
model_format="pth", model_format="pth",
model_family="llama") model_family="llama")
# gptq model # gptq model
llm_convert(model="/path/to/vicuna-13B-1.1-GPTQ-4bit-128g.pt", llm_convert(model="/path/to/vicuna-13B-1.1-GPTQ-4bit-128g/",
outfile="/path/to/out.bin", outfile="/path/to/vicuna-13B-int4/",
model_format="gptq", model_format="gptq",
tokenizer_path="/path/to/tokenizer.model",
model_family="llama") model_family="llama")
``` ```