Ruonan Wang
ddff7a6f05
Update readme of GPU to specify oneapi version( #8820 )
2023-08-29 13:14:22 +08:00
Yina Chen
35fdf94031
[LLM]Arc starcoder example ( #8814 )
...
* arc starcoder example init
* add log
* meet comments
2023-08-28 16:48:00 +08:00
Ruonan Wang
eae92bc7da
llm: quick fix path ( #8810 )
2023-08-25 16:02:31 +08:00
Ruonan Wang
0186f3ab2f
llm: update all ARC int4 examples ( #8809 )
...
* update GPU examples
* update other examples
* fix
* update based on comment
2023-08-25 15:26:10 +08:00
binbin Deng
5582872744
LLM: update chatglm example to be more friendly for beginners ( #8795 )
2023-08-25 10:55:01 +08:00
Yina Chen
7c37424a63
Fix voice assistant example input error on Linux ( #8799 )
...
* fix linux error
* update
* remove alsa log
2023-08-25 10:47:27 +08:00
Ruonan Wang
e9aa2bd890
LLM: reduce GPU 1st token latency and update example ( #8763 )
...
* reduce 1st token latency
* update example
* fix
* fix style
* update readme of gpu benchmark
2023-08-16 18:01:23 +08:00
binbin Deng
06609d9260
LLM: add qwen example on arc ( #8757 )
2023-08-16 17:11:08 +08:00
Song Jiaming
c1f9af6d97
[LLM] chatglm example and transformers low-bit examples ( #8751 )
2023-08-16 11:41:44 +08:00
binbin Deng
97283c033c
LLM: add falcon example on arc ( #8742 )
2023-08-15 17:38:38 +08:00
binbin Deng
8c55911308
LLM: add baichuan-13B on arc example ( #8755 )
2023-08-15 15:07:04 +08:00
Ruonan Wang
d28ad8f7db
LLM: add whisper example for arc transformer int4 ( #8749 )
...
* add whisper example for arc int4
* fix
2023-08-14 17:05:48 +08:00
Ruonan Wang
faaccb64a2
LLM: add chatglm2 example for Arc ( #8741 )
...
* add chatglm2 example
* update
* fix readme
2023-08-14 10:43:08 +08:00
binbin Deng
b10d7e1adf
LLM: add mpt example on arc ( #8723 )
2023-08-14 09:40:01 +08:00
binbin Deng
e9a1afffc5
LLM: add internlm example on arc ( #8722 )
2023-08-14 09:39:39 +08:00
SONG Ge
aceea4dc29
[LLM] Unify Transformers and Native API ( #8713 )
...
* re-open pr to run on latest runner
* re-add examples and ut
* rename ut and move deprecate to warning instead of raising an error info
* ut fix
2023-08-11 19:45:47 +08:00
Shengsheng Huang
7c56c39e36
Fix GPU examples READ to use bigdl-core-xe ( #8714 )
...
* Update README.md
* Update README.md
2023-08-10 12:53:49 +08:00
Yina Chen
6d1ca88aac
add voice assistant example ( #8711 )
2023-08-10 12:42:14 +08:00
Ruonan Wang
1a7b698a83
[LLM] support ipex arc int4 & add basic llama2 example ( #8700 )
...
* first support of xpu
* make it works on gpu
update setup
update
add GPU llama2 examples
add use_optimize flag to disbale optimize for gpu
fix style
update gpu exmaple readme
fix
* update example, and update env
* fix setup to add cpp files
* replace jit with aot to avoid data leak
* rename to bigdl-core-xe
* update installation in example readme
2023-08-09 22:20:32 +08:00
binbin Deng
4c44153584
LLM: add Qwen transformers int4 example ( #8699 )
2023-08-08 11:23:09 +08:00
binbin Deng
6fc31bb4cf
LLM: first update descriptions for ChatGLM transformers int4 example ( #8646 )
2023-08-02 11:00:56 +08:00
binbin Deng
39994738d1
LLM: add chat & stream chat example for ChatGLM2 transformers int4 ( #8636 )
2023-08-01 14:57:45 +08:00
Zhao Changmin
d6cbfc6d2c
LLM: Add requirements in whisper example ( #8644 )
...
* LLM: Add requirements in whisper example
2023-08-01 12:07:14 +08:00
binbin Deng
3dbab9087b
LLM: add llama2-7b native int4 example ( #8629 )
2023-07-28 10:56:16 +08:00
binbin Deng
fcf8c085e3
LLM: add llama2-13b native int4 example ( #8613 )
2023-07-26 10:12:52 +08:00
binbin Deng
3f24202e4c
[LLM] Add more transformers int4 example (Llama 2) ( #8602 )
2023-07-25 09:21:12 +08:00
Jason Dai
0f8201c730
llm readme update ( #8595 )
2023-07-24 09:47:49 +08:00
Yuwen Hu
6504e31a97
Small fix ( #8577 )
2023-07-20 16:37:04 +08:00
Yuwen Hu
cad78740a7
[LLM] Small fixes to the Whisper transformers INT4 example ( #8573 )
...
* Small fixes to the whisper example
* Small fix
* Small fix
2023-07-20 10:11:33 +08:00
binbin Deng
7a9fdf74df
[LLM] Add more transformers int4 example (Dolly v2) ( #8571 )
...
* add
* add trust_remote_mode
2023-07-19 18:20:16 +08:00
binbin Deng
457571b44e
[LLM] Add more transformers int4 example (InternLM) ( #8557 )
2023-07-19 15:15:38 +08:00
Zhao Changmin
49d636e295
[LLM] whisper model transformer int4 verification and example ( #8511 )
...
* LLM: transformer api support
* va
* example
* revert
* pep8
* pep8
2023-07-19 08:33:20 +08:00
Jason Dai
1ebc43b151
Update READMEs ( #8554 )
2023-07-18 11:06:06 +08:00
Yuwen Hu
ee70977c07
[LLM] Transformers int4 example small typo fixes ( #8550 )
2023-07-17 18:15:32 +08:00
Yuwen Hu
1344f50f75
[LLM] Add more transformers int4 examples (Falcon) ( #8546 )
...
* Initial commit
* Add Falcon examples and other small fix
* Small fix
* Small fix
* Update based on comments
* Small fix
2023-07-17 17:36:21 +08:00
Yuwen Hu
de772e7a80
Update mpt for prompt tuning ( #8547 )
2023-07-17 17:33:54 +08:00
binbin Deng
f1fd746722
[LLM] Add more transformers int4 example (vicuna) ( #8544 )
2023-07-17 16:59:55 +08:00
Xin Qiu
fccae91461
Add load_low_bit save_load_bit to AutoModelForCausalLM ( #8531 )
...
* transformers save_low_bit load_low_bit
* update example and add readme
* update
* update
* update
* add ut
* update
2023-07-17 15:29:55 +08:00
binbin Deng
808a64d53a
[LLM] Add more transformers int4 example (starcoder) ( #8540 )
2023-07-17 14:41:19 +08:00
binbin Deng
f56b5ade4c
[LLM] Add more transformers int4 example (chatglm2) ( #8539 )
2023-07-14 17:58:33 +08:00
binbin Deng
92d33cf35a
[LLM] Add more transformers int4 example (phoenix) ( #8520 )
2023-07-14 17:58:04 +08:00
Yuwen Hu
e0f0def279
Remove unused example for now ( #8538 )
2023-07-14 17:32:50 +08:00
binbin Deng
b397e40015
[LLM] Add more transformers int4 example (RedPajama) ( #8523 )
2023-07-14 17:30:28 +08:00
Yuwen Hu
7bf3e10415
[LLM] Add more int4 transformers examples (MOSS) ( #8532 )
...
* Add Moss example
* Small fix
2023-07-14 16:41:41 +08:00
Yuwen Hu
59b7287ef5
[LLM] Add more transformers int4 example (Baichuan) ( #8522 )
...
* Add example model Baichuan
* Small updates to client windows settings
* Small refactor
* Small fix
2023-07-14 16:41:29 +08:00
Yuwen Hu
ca6e38607c
[LLM] Add more transformers examples (ChatGLM) ( #8521 )
...
* Add example for chatglm v1 and other small fixes
* Small fix
* Small further fix
* Small fix
* Update based on comments & updates for client windows recommended settingts
* Small fix
* Small refactor
* Small fix
* Small fix
* Small fix to dolly v1
* Small fix
2023-07-14 16:41:13 +08:00
Yuwen Hu
349bcb4bae
[LLM] Add more transformers int4 example (Dolly v1) ( #8517 )
...
* Initial commit for dolly v1
* Add example for Dolly v1 and other small fix
* Small output updates
* Small fix
* fix based on comments
2023-07-13 16:13:47 +08:00
Yuwen Hu
bcde8ec83e
[LLM] Small fix to MPT Example ( #8513 )
2023-07-13 14:33:21 +08:00
Yuwen Hu
fcc352eee3
[LLM] Add more transformers_int4 examples (MPT) ( #8498 )
...
* Update transformers_int4 readme, and initial commit for mpt
* Update example for mpt
* Small fix and recover transformers_int4_pipeline_readme.md for now
* Update based on comments
* Small fix
* Small fix
* Update based on comments
2023-07-13 09:41:16 +08:00
Yuwen Hu
52c6b057d6
Initial LLM Transformers example refactor ( #8491 )
2023-07-10 17:53:57 +08:00
