ipex-llm/docker/llm/serving
Wang, Jian4 1eed0635f2
Add lightweight serving and support tgi parameter (#11600)
* init tgi request

* update openai api

* update for pp

* update and add readme

* add to docker

* add start bash

* update

* update

* update
2024-07-19 13:15:56 +08:00
..
cpu Docs: Fix CPU Serving Docker README (#11351) 2024-06-18 16:27:51 +08:00
xpu/docker Add lightweight serving and support tgi parameter (#11600) 2024-07-19 13:15:56 +08:00