ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Fix typo in vLLM CPU docker guide (#11188)

Browse source
This commit is contained in:
Xiangyu Tian 2024-06-03 15:55:27 +08:00 committed by GitHub
parent 15a6205790
commit ff83fad400
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docs/readthedocs/source/doc/LLM/DockerGuides/vllm_cpu_docker_quickstart.md
View file

@ -40,7 +40,7 @@ After the container is booted, you could get into the container through `docker
docker exec -it ipex-llm-serving-cpu-container /bin/bash docker exec -it ipex-llm-serving-cpu-container /bin/bash
``` ```
## Running vLLM serving with IPEX-LLM on Intel GPU in Docker ## Running vLLM serving with IPEX-LLM on Intel CPU in Docker
We have included multiple vLLM-related files in `/llm/`: We have included multiple vLLM-related files in `/llm/`:
1. `vllm_offline_inference.py`: Used for vLLM offline inference example 1. `vllm_offline_inference.py`: Used for vLLM offline inference example