BigDL-LLM
=========================


BigDL-LLM is a library for running LLM (Large Language Models) on your Intel laptop using INT4 with very low latency (for any Hugging Face Transformers model).

-------

.. grid:: 1 2 2 2
    :gutter: 2

    .. grid-item-card::

        **API Document**
        ^^^

        API Document provides detailed description of BigDL-LLM APIs.

        +++

        :bdg-link:`API Document <../PythonAPI/LLM/index.html>`

..  toctree::
    :hidden:

    BigDL-LLM Document <self>