ipex-llm/python
Ruonan Wang f1156e6b20
support gguf_q4k_m / gguf_q4k_s (#10887)
* initial commit

* UPDATE

* fix style

* fix style

* add gguf_q4k_s

* update comment

* fix
2024-05-17 14:30:09 +08:00
..
llm support gguf_q4k_m / gguf_q4k_s (#10887) 2024-05-17 14:30:09 +08:00