Yang Wang 9e763b049c Support running pipeline parallel inference by vertically partitioning model to different devices (#10392) ... * support pipeline parallel inference * fix logging * remove benchmark file * fic * need to warmup twice * support qwen and qwen2 * fix lint * remove genxir * refine		2024-03-18 13:04:45 -07:00
..
CPU	LLM: remove CPU english_quotes dataset and update docker example (#10399)	2024-03-18 10:45:14 +08:00
GPU	Support running pipeline parallel inference by vertically partitioning model to different devices (#10392)	2024-03-18 13:04:45 -07:00