Yuwen Hu 27d9a14989 [LLM] all-on-one update: memory optimize and streaming output (#10302) ... * Memory saving for continous in-out pair run and add support for streaming output on MTL iGPU * Small fix * Small fix * Add things back		2024-03-01 18:02:30 +08:00
..
benchmark	[LLM] all-on-one update: memory optimize and streaming output (#10302)	2024-03-01 18:02:30 +08:00
test	Integrate vllm (#9310)	2023-11-23 16:46:45 +08:00
print_glib_requirement.py	LLM: add a dev tool for getting glibc/glibcxx requirement (#8399)	2023-06-30 11:09:50 +08:00
release.sh	[LLM] add convert's python deps for LLM (#8260)	2023-06-06 16:01:17 +08:00
release_default_linux.sh	[LLM] Add dev wheel building and basic UT script for LLM package on Linux (#8264)	2023-06-08 00:49:57 +08:00
release_default_windows.sh	Add dev wheel building script for LLM package on Windows (#8238)	2023-06-01 11:55:26 +08:00