Xiangyu Tian
|
8ddae22cfb
|
LLM: Refactor Pipeline-Parallel-FastAPI example (#11319)
Initially Refactor for Pipeline-Parallel-FastAPI example
|
2024-06-25 13:30:36 +08:00 |
|
Xiangyu Tian
|
4359ab3172
|
LLM: Add /generate_stream endpoint for Pipeline-Parallel-FastAPI example (#11187)
Add /generate_stream and OpenAI-formatted endpoint for Pipeline-Parallel-FastAPI example
|
2024-06-14 15:15:32 +08:00 |
|
Xiangyu Tian
|
2299698b45
|
Refine Pipeline Parallel FastAPI example (#11168)
|
2024-05-29 17:16:50 +08:00 |
|
Xiangyu Tian
|
5c8ccf0ba9
|
LLM: Add Pipeline-Parallel-FastAPI example (#10917)
Add multi-stage Pipeline-Parallel-FastAPI example
---------
Co-authored-by: hzjane <a1015616934@qq.com>
|
2024-05-27 14:46:29 +08:00 |
|