ipex-llm/docs/readthedocs/source/doc/LLM/Overview/FAQ/general_info.md
2024-02-01 09:43:39 +08:00

608 B

FAQ: General Info & Concepts

Refer to this section for general information about BigDL-LLM.

BigDL-LLM Support

GGUF format usage with BigDL-LLM?

BigDL-LLM supports running GGUF/AWQ/GPTQ models on both CPU and GPU. Please also refer to here for our latest support.