2 commits

Author	SHA1	Message	Date
Wang, Jian4	1eed0635f2	Add lightweight serving and support tgi parameter (#11600) ... * init tgi request * update openai api * update for pp * update and add readme * add to docker * add start bash * update * update * update	2024-07-19 13:15:56 +08:00
Wang, Jian4	9c15abf825	Refactor fastapi-serving and add one card serving(#11581) ... * init fastapi-serving one card * mv api code to source * update worker * update for style-check * add worker * update bash * update * update worker name and add readme * rename update * rename to fastapi	2024-07-17 11:12:43 +08:00

Renamed from python/llm/example/GPU/Pipeline-Parallel-FastAPI/wrk_script_1024.lua (Browse further)