ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/GPU/Deepspeed-AutoTP-FastAPI/prompt
History
ZehuaCao 751e1a4e29
Fix concurrent issue in autoTP streming. (#11150) 
* add benchmark test

* update
2024-05-29 08:22:38 +08:00
..
32.txt Fix concurrent issue in autoTP streming. (#11150) 2024-05-29 08:22:38 +08:00
1024.txt Fix concurrent issue in autoTP streming. (#11150) 2024-05-29 08:22:38 +08:00
2048.txt Fix concurrent issue in autoTP streming. (#11150) 2024-05-29 08:22:38 +08:00