ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python
History
Xiangyu Tian 3d4950b0f0
LLM: Enable batch generate (world_size>1) in Deepspeed-AutoTP-FastAPI example (#10876) 
Enable batch generate (world_size>1) in Deepspeed-AutoTP-FastAPI example.
2024-04-26 13:24:28 +08:00
..
llm LLM: Enable batch generate (world_size>1) in Deepspeed-AutoTP-FastAPI example (#10876) 2024-04-26 13:24:28 +08:00