ipex-llm/python/llm/src/bigdl
Cengguang Zhang 496d18ab6d LLM: add quantize kv cache support for baichuan 7b and 13b. (#10330)
* add quantize kv cache for baichuan 7b and 13b.

* fix typo.

* fix.

* fix style.

* fix style.
2024-03-07 16:17:38 +08:00
..
llm LLM: add quantize kv cache support for baichuan 7b and 13b. (#10330) 2024-03-07 16:17:38 +08:00
__init__.py LLM: add first round files (#8225) 2023-05-25 11:29:18 +08:00