Shengsheng Huang 446175cc05 transformer api refactor (#8389) ... * transformer api refactor * fix style * add huggingface tokenizer usage in example and make ggml tokenzizer as option 1 and huggingface tokenizer as option 2 * fix style		2023-06-25 17:15:33 +08:00
..
langchain	[LLM] langchain integrations and examples (#8256)	2023-06-12 19:22:07 +08:00
transformers	transformer api refactor (#8389)	2023-06-25 17:15:33 +08:00
simple.py	[LLM] langchain integrations and examples (#8256)	2023-06-12 19:22:07 +08:00
transformers_int4.py	Support directly quantizing huggingface transformers into 4bit format (#8371)	2023-06-25 16:35:06 +08:00