ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

small fix of cpp readme(#12425)

Browse source
This commit is contained in:
Ruonan Wang 2024-11-21 02:21:34 -08:00 committed by GitHub
parent 8fdc36c140
commit 2935e97610
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
python/llm/example/NPU/HF-Transformers-AutoModels/LLM/CPP_Examples/README.md
View file

@ -30,11 +30,11 @@ pip install transformers==4.45.0 accelerate==0.33.0
``` ```
## 2. Convert Model ## 2. Convert Model
We provide a [convert script](convert_model.py) under current directory, by running it, you can obtain the whole weights and configuration files which are required to run C++ example. We provide a [convert script](convert.py) under current directory, by running it, you can obtain the whole weights and configuration files which are required to run C++ example.
```cmd ```cmd
:: to convert Qwen2.5-7b-Instruct :: to convert Qwen2.5-7b-Instruct
python convert_model.py --repo-id-or-model-path Qwen/Qwen2.5-7B-Instruct --save-directory <converted_model_path> python convert.py --repo-id-or-model-path Qwen/Qwen2.5-7B-Instruct --save-directory <converted_model_path>
``` ```