ipex-llm/python/llm/example
Yang Wang ce6d06eb0a Support directly quantizing huggingface transformers into 4bit format (#8371)
* Support directly quantizing huggingface transformers into 4bit format

* refine example

* license

* fix bias

* address comments

* move to ggml transformers

* fix example

* fix style

* fix style

* address comments

* rename

* change API

* fix style

* add lm head to conversion

* address comments
2023-06-25 16:35:06 +08:00
..
langchain [LLM] langchain integrations and examples (#8256) 2023-06-12 19:22:07 +08:00
transformers [LLM] Supports GPTQ convert in transfomers-like API, and supports folder outfile for llm-convert (#8366) 2023-06-20 17:42:38 +08:00
simple.py [LLM] langchain integrations and examples (#8256) 2023-06-12 19:22:07 +08:00
transformers_int4.py Support directly quantizing huggingface transformers into 4bit format (#8371) 2023-06-25 16:35:06 +08:00