ipex-llm/docker/llm/inference
Wang, Jian4 1eed0635f2
Add lightweight serving and support tgi parameter (#11600)
* init tgi request

* update openai api

* update for pp

* update and add readme

* add to docker

* add start bash

* update

* update

* update
2024-07-19 13:15:56 +08:00
..
cpu/docker Fix docker images (#11362) 2024-06-20 15:44:55 +08:00
xpu/docker Add lightweight serving and support tgi parameter (#11600) 2024-07-19 13:15:56 +08:00