ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update README.md (#13113)

Browse source
This commit is contained in:
Guancheng Fu 2025-04-27 17:13:18 +08:00 committed by GitHub
parent 16fa778e65
commit d222eaffd7
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 2 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
python/llm/example/GPU/vLLM-Serving/README.md
View file

@ -336,6 +336,8 @@ python -m ipex_llm.vllm.xpu.entrypoints.openai.api_server \
``` ```
After seaching has completed, it will show the recommended maximum context length in the log like: After seaching has completed, it will show the recommended maximum context length in the log like:
![max_length](./max_length.png) ![max_length](./max_length.png)
Then, you can start the service with this maximum length: Then, you can start the service with this maximum length: