Yishuo Wang
|
c11f5f0fcd
|
also convert SdpaAttention in optimize_model (#12673)
|
2025-01-08 16:48:03 +08:00 |
|
Yishuo Wang
|
ddc0ef3993
|
refactor device check and remove cohere/mixtral support (#12659)
|
2025-01-07 11:15:51 +08:00 |
|
Yishuo Wang
|
098eb335b2
|
refactor sd 1.5 and qwen2-vl and fix (#12590)
|
2024-12-20 17:34:55 +08:00 |
|
Yishuo Wang
|
b050368efc
|
refactor yuan2 and starcoder2 and fix (#12589)
|
2024-12-20 16:41:50 +08:00 |
|
Yishuo Wang
|
80f2fdc37b
|
optimize new minicpm model (#12579)
|
2024-12-19 14:22:47 +08:00 |
|
Yishuo Wang
|
4540424271
|
optimize siglip attention again (#12578)
|
2024-12-19 13:40:48 +08:00 |
|
Yishuo Wang
|
e2ae42929a
|
small fix (#12573)
|
2024-12-18 15:48:22 +08:00 |
|
Yishuo Wang
|
a4eb561f36
|
optimize siglip attention on arc (#12569)
|
2024-12-18 14:19:43 +08:00 |
|
Yishuo Wang
|
dc34e8c51f
|
optimize glm4v vision attention (#12369)
|
2024-11-08 17:01:57 +08:00 |
|
Yishuo Wang
|
540eaeb12c
|
refactor attention_softmax (#12295)
|
2024-10-30 13:20:50 +08:00 |
|
Yuwen Hu
|
a9e485eb1b
|
Support MiniCPM-V-2_6 multi-modal benchmarking with latency text streamer (#11963)
* Support MiniCPM-V-2_6 multi-modal benchmarking with latency text streamer
* Style fixes
|
2024-08-29 19:22:09 +08:00 |
|
Yishuo Wang
|
2946420e14
|
add minicpmv 2.6 load_low_bit workaround (#11856)
|
2024-08-20 11:16:02 +08:00 |
|
Yishuo Wang
|
750d4ad5dc
|
fix minicpm-v-2 fp16 (#11819)
|
2024-08-15 18:34:40 +08:00 |
|
Yishuo Wang
|
828ab16537
|
fix phi3 and minicpmv cpu (#11818)
|
2024-08-15 17:43:29 +08:00 |
|
Yishuo Wang
|
9a93808fc5
|
fix and optimize minicpm v 2 (#11799)
|
2024-08-14 17:27:23 +08:00 |
|
Yishuo Wang
|
3d6cfa291d
|
optimize minicpm v 2.5 (#11793)
|
2024-08-14 16:07:24 +08:00 |
|
Yishuo Wang
|
a184b120c9
|
fix minicpm-v 2.5 (#11780)
|
2024-08-13 16:14:00 +08:00 |
|
Yishuo Wang
|
aa861df066
|
use new fp32 softmax kernel (#11776)
|
2024-08-13 14:48:11 +08:00 |
|
Yishuo Wang
|
a1eb793f70
|
optimize minicpm v 2_6 firs token perf (#11770)
|
2024-08-13 09:51:18 +08:00 |
|
Yishuo Wang
|
57d177738d
|
optimize minicpm-v-2_6 repetition penalty (#11763)
|
2024-08-12 14:10:10 +08:00 |
|
Yishuo Wang
|
93455aac09
|
fix minicpm V 2.6 repeat output (#11753)
|
2024-08-09 17:39:24 +08:00 |
|
Yishuo Wang
|
54cc9353db
|
support and optimize minicpm-v-2_6 (#11738)
|
2024-08-07 18:21:16 +08:00 |
|