ipex-llm/python/llm/example/GPU/Pipeline-Parallel-FastAPI/prompt
Xiangyu Tian 4359ab3172
LLM: Add /generate_stream endpoint for Pipeline-Parallel-FastAPI example (#11187)
Add /generate_stream and OpenAI-formatted endpoint for Pipeline-Parallel-FastAPI example
2024-06-14 15:15:32 +08:00
..
32.txt
128.txt
1024.txt
2048.txt