ipex-llm/python/llm/example/GPU/Pipeline-Parallel-FastAPI/prompt
Xiangyu Tian 4359ab3172
LLM: Add /generate_stream endpoint for Pipeline-Parallel-FastAPI example (#11187)
Add /generate_stream and OpenAI-formatted endpoint for Pipeline-Parallel-FastAPI example
2024-06-14 15:15:32 +08:00
..
32.txt LLM: Add /generate_stream endpoint for Pipeline-Parallel-FastAPI example (#11187) 2024-06-14 15:15:32 +08:00
128.txt LLM: Add /generate_stream endpoint for Pipeline-Parallel-FastAPI example (#11187) 2024-06-14 15:15:32 +08:00
1024.txt LLM: Add /generate_stream endpoint for Pipeline-Parallel-FastAPI example (#11187) 2024-06-14 15:15:32 +08:00
2048.txt LLM: Add /generate_stream endpoint for Pipeline-Parallel-FastAPI example (#11187) 2024-06-14 15:15:32 +08:00