10 commits

Author	SHA1	Message	Date
SONG Ge	5b83493b1a	Add ipex-llm npu option in setup.py (#11858) ... * add ipex-llm npu release * update example doc * meet latest release changes	2024-08-20 17:29:49 +08:00
SONG Ge	7380823f3f	Update Llama2 multi-processes example (#11852) ... * update llama2 multi-processes examples * update * update readme * update	2024-08-19 19:49:01 +08:00
Yang Wang	99b05ba1dc	separate prefill into a process (#11787) ... * seperate prefill into a process * using model.share_memory() * might work * worked * use long prompt * refactor * cleanup * fix bug * clean up * changable inter and intra process stages * refactor * add max output len * fix npu_model changes that may cause generate down * fix npu_model generate import error * fix generare forward error --------- Co-authored-by: sgwhat <ge.song@intel.com>	2024-08-19 17:53:36 +08:00
binbin Deng	23d3acdc77	Add experimental support of fused decoder layer for llama2 (#11768)	2024-08-13 14:41:36 +08:00
Jin, Qiao	05989ad0f9	Update npu example and all in one benckmark (#11766)	2024-08-12 16:46:46 +08:00
Jin, Qiao	a44ab32153	Switch to conhost when running on NPU (#11687)	2024-07-30 17:08:06 +08:00
Zhao Changmin	06745e5742	Add npu benchmark all-in-one script (#11571) ... * npu benchmark	2024-07-15 10:42:37 +08:00
Zhao Changmin	b9c66994a5	add npu sdp (#11562)	2024-07-11 16:57:35 +08:00
Zhao Changmin	3c16c9f725	Optimize baichuan on NPU (#11548) ... * baichuan_npu	2024-07-10 13:18:48 +08:00
Zhao Changmin	76a5802acf	update NPU examples (#11540) ... * update NPU examples	2024-07-09 17:19:42 +08:00

Renamed from python/llm/example/NPU/HF-Transformers-AutoModels/Model/llama2/README.md (Browse further)