3 commits

Author	SHA1	Message	Date
Wang, Jian4	9c15abf825	Refactor fastapi-serving and add one card serving(#11581) ... * init fastapi-serving one card * mv api code to source * update worker * update for style-check * add worker * update bash * update * update worker name and add readme * rename update * rename to fastapi	2024-07-17 11:12:43 +08:00
binbin Deng	987017ef47	Update pipeline parallel serving for more model support (#11428)	2024-06-27 18:21:01 +08:00
Xiangyu Tian	4359ab3172	LLM: Add /generate_stream endpoint for Pipeline-Parallel-FastAPI example (#11187) ... Add /generate_stream and OpenAI-formatted endpoint for Pipeline-Parallel-FastAPI example	2024-06-14 15:15:32 +08:00