binbin Deng
14626fe05b
LLM: refactor transformers and langchain class name ( #8470 )
2023-07-06 17:16:44 +08:00
binbin Deng
70bc8ea8ae
LLM: update langchain and cpp-python style API examples ( #8456 )
2023-07-06 14:36:42 +08:00
binbin Deng
1970bcf14e
LLM: add readme for transformer examples ( #8444 )
2023-07-04 17:25:58 +08:00
binbin Deng
c956a46c40
LLM: first fix example/transformers ( #8438 )
2023-07-03 14:13:33 +08:00
binbin Deng
ca5a4b6e3a
LLM: update bloom and starcoder usage in transformers_int4_pipeline ( #8406 )
2023-06-28 13:15:50 +08:00
Ruonan Wang
4be784a49d
LLM: add UT for starcoder (convert, inference) update examples and readme ( #8379 )
...
* first commit to add path
* update example and readme
* update path
* fix
* update based on comment
2023-06-27 12:12:11 +08:00
Shengsheng Huang
446175cc05
transformer api refactor ( #8389 )
...
* transformer api refactor
* fix style
* add huggingface tokenizer usage in example and make ggml tokenzizer as option 1 and huggingface tokenizer as option 2
* fix style
2023-06-25 17:15:33 +08:00
Yuwen Hu
7ef1c890eb
[LLM] Supports GPTQ convert in transfomers-like API, and supports folder outfile for llm-convert ( #8366 )
...
* Add docstrings to llm_convert
* Small docstrings fix
* Unify outfile type to be a folder path for either gptq or pth model_format
* Supports gptq model input for from_pretrained
* Fix example and readme
* Small fix
* Python style fix
* Bug fix in llm_convert
* Python style check
* Fix based on comments
* Small fix
2023-06-20 17:42:38 +08:00
Zhao Changmin
4d177ca0a1
LLM: Merge convert pth/gptq model script into one shell script ( #8348 )
...
* convert model in one
* model type
* license
* readme and pep8
* ut path
* rename
* readme
* fix docs
* without lines
2023-06-19 11:50:05 +08:00
Yuwen Hu
f83c48280f
[LLM] Unify transformers-like API example for 3 different model families ( #8315 )
...
* Refactor bigdl-llm transformers-like API to unify them
* Small fix
2023-06-12 17:20:30 +08:00
