Yuwen Hu
|
356281cb80
|
Further all-in-one benchmark update continuation task (#11784)
* Further update prompt for continuation task, and disable lookup candidate update strategy on MTL
* style fix
|
2024-08-14 14:39:34 +08:00 |
|
Ruonan Wang
|
8db34057b4
|
optimize lookahead init time (#11769)
|
2024-08-12 17:19:12 +08:00 |
|
Ruonan Wang
|
66fe2ee464
|
initial support of IPEX_LLM_PERFORMANCE_MODE (#11754)
* add perf mode
* update
* fix style
|
2024-08-09 19:04:09 +08:00 |
|
Zhao Changmin
|
b7948671de
|
[WIP] Add look up table in 1st token stage (#11193)
* lookuptb
|
2024-06-07 10:51:05 +08:00 |
|
hxsz1997
|
93d40ab127
|
Update lookahead strategy (#11021)
* update lookahead strategy
* remove lines
* fix python style check
|
2024-05-15 14:48:05 +08:00 |
|
Yina Chen
|
015d07a58f
|
Fix lookahead sample error & add update strategy (#10894)
* Fix sample error & add update strategy
* add mtl config
* fix style
* remove print
|
2024-04-28 17:21:00 +08:00 |
|
Yina Chen
|
3daad242b8
|
Fix No module named 'transformers.cache_utils' with transformers < 4.36 (#10835)
* update sdp condition
* update
* fix
* fix 431 error
* revert sdp & style fix
* fix
* meet comments
|
2024-04-22 14:05:50 +08:00 |
|
Yina Chen
|
ea5b373a97
|
Add lookahead GPU example (#10785)
* Add lookahead example
* fix style & attn mask
* fix typo
* address comments
|
2024-04-17 17:41:55 +08:00 |
|
Yina Chen
|
899d392e2f
|
Support prompt lookup in ipex-llm (#10768)
* lookup init
* add lookup
* fix style
* remove redundant code
* change param name
* fix style
|
2024-04-16 16:52:38 +08:00 |
|