2 commits

Author	SHA1	Message	Date
Ruonan Wang	b9eae23c79	LLM: add chatglm-6b example for transformer_int4 usage (#8392) ... * add example for chatglm-6b * fix	2023-06-26 13:46:43 +08:00
Yang Wang	ce6d06eb0a	Support directly quantizing huggingface transformers into 4bit format (#8371) ... * Support directly quantizing huggingface transformers into 4bit format * refine example * license * fix bias * address comments * move to ggml transformers * fix example * fix style * fix style * address comments * rename * change API * fix style * add lm head to conversion * address comments	2023-06-25 16:35:06 +08:00