ipex-llm/python
Xiangyu Tian 5c03651309 [LLM] vLLM: Add Preempt for scheduler (#9568)
Implement Preempt_by_recompute method for vllm.
2023-12-03 20:16:25 +08:00
..
llm [LLM] vLLM: Add Preempt for scheduler (#9568) 2023-12-03 20:16:25 +08:00