Wang, Jian4 191b184341 LLM: Optimize cohere model (#10878) ... * use mlp and rms * optimize kv_cache * add fuse qkv * add flash attention and fp16 sdp * error fp8 sdp * fix optimized * fix style * update * add for pp		2024-05-07 10:19:50 +08:00
..
dev	LLM: add min_new_tokens to all in one benchmark. (#10911)	2024-05-06 09:32:59 +08:00
example	LLM: Refine Deepspped-AutoTP-FastAPI example (#10916)	2024-05-07 09:37:31 +08:00
portable-zip	Fix baichuan-13b issue on portable zip under transformers 4.36 (#10746)	2024-04-12 16:27:01 -07:00
scripts	Update scripts readme (#10725)	2024-04-25 17:24:37 +08:00
src/ipex_llm	LLM: Optimize cohere model (#10878)	2024-05-07 10:19:50 +08:00
test	Add phi-3 to perf (#10883)	2024-04-25 20:21:56 +08:00
.gitignore	[LLM] add chatglm pybinding binary file release (#8677)	2023-08-04 11:45:27 +08:00
setup.py	Support llama-index install option for upstreaming purposes (#10866)	2024-04-23 19:08:29 +08:00
version.txt	Update setup.py and add new actions and add compatible mode (#25)	2024-03-22 15:44:59 +08:00