26 lines
No EOL
504 B
ReStructuredText
26 lines
No EOL
504 B
ReStructuredText
BigDL-LLM
|
|
=========================
|
|
|
|
|
|
BigDL-LLM is a library for running LLM (Large Language Models) on your Intel laptop using INT4 with very low latency (for any Hugging Face Transformers model).
|
|
|
|
-------
|
|
|
|
.. grid:: 1 2 2 2
|
|
:gutter: 2
|
|
|
|
.. grid-item-card::
|
|
|
|
**API Document**
|
|
^^^
|
|
|
|
API Document provides detailed description of LLM APIs.
|
|
|
|
+++
|
|
|
|
:bdg-link:`API Document <../PythonAPI/LLM/index.html>`
|
|
|
|
.. toctree::
|
|
:hidden:
|
|
|
|
BigDL-LLM Document <self> |