ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update README.md (#11003)

Browse source
This commit is contained in:
Guancheng Fu 2024-05-13 16:44:48 +08:00 committed by GitHub
parent 74997a3ed1
commit a465111cf4
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
python/llm/src/ipex_llm/serving/fastchat/README.md
View file

@ -78,7 +78,7 @@ We have also provided an option `--load-low-bit-model` to load models that have
Check the following examples:
```bash
# Or --device "cpu"
python -m ipex_llm.serving.fastchat.ipex_llm_worker --model-path /Low/Bit/Model/Path --trust-remote-code --device "xpu"
python -m ipex_llm.serving.fastchat.ipex_llm_worker --model-path /Low/Bit/Model/Path --trust-remote-code --device "xpu" --load-low-bit-model
```
#### For self-speculative decoding example: