cf6a620bae
* Change order of LLM in header * Some updates to footer * Add BigDL-LLM index page and basic file structure * Update index page for key features * Add initial content for BigDL-LLM in 5 mins * Improvement to footnote * Add initial contents based on current contents we have * Add initial quick links * Small fix * Rename file * Hide cli section for now and change model supports to examples * Hugging Face format -> Hugging Face transformers format * Add placeholder for GPU supports * Add GPU related content structure * Add cpu/gpu installation initial contents * Add initial contents for GPU supports * Add image link to LLM index page * Hide tips and known issues for now * Small fix * Update based on comments * Small fix * Add notes for Python 3.9 * Add placehoder optimize model & reveal CLI; small revision * examples add gpu part * Hide CLI part again for first version of merging * add keyfeatures-optimize_model part (#1) * change gif link to the ones hosted on github * Small fix --------- Co-authored-by: plusbang <binbin1.deng@intel.com> Co-authored-by: binbin Deng <108676127+plusbang@users.noreply.github.com>
77 lines
2.2 KiB
ReStructuredText
77 lines
2.2 KiB
ReStructuredText
BigDL-LLM
|
|
=========================
|
|
|
|
.. raw:: html
|
|
|
|
<p>
|
|
<strong>BigDL-LLM</strong> is a library for running <strong>LLM</strong> (large language model) on your Intel <strong>laptop</strong> or <strong>GPU</strong> using INT4 with very low latency <sup><a href="#footnote-perf" id="ref-perf">[1]</a></sup> (for any <strong>PyTorch</strong> model).
|
|
</p>
|
|
|
|
-------
|
|
|
|
.. grid:: 1 2 2 2
|
|
:gutter: 2
|
|
|
|
.. grid-item-card::
|
|
|
|
**Get Started**
|
|
^^^
|
|
|
|
Documents in these sections helps you getting started quickly with BigDL-LLM.
|
|
|
|
+++
|
|
:bdg-link:`BigDL-LLM in 5 minutes <./Overview/quick_start.html>` |
|
|
:bdg-link:`Installation <./Overview/install.html>`
|
|
|
|
.. grid-item-card::
|
|
|
|
**Key Features Guide**
|
|
^^^
|
|
|
|
Each guide in this section provides you with in-depth information, concepts and knowledges about BigDL-LLM key features.
|
|
|
|
+++
|
|
|
|
:bdg-link:`transformers-style <./Overview/KeyFeatures/transformers_style_api.html>` |
|
|
:bdg-link:`Optimize Model <./Overview/KeyFeatures/optimize_model.html>` |
|
|
:bdg-link:`LangChain <./Overview/KeyFeatures/langchain_api.html>` |
|
|
:bdg-link:`GPU <./Overview/KeyFeatures/gpu_supports.html>`
|
|
|
|
.. grid-item-card::
|
|
|
|
**Examples & Tutorials**
|
|
^^^
|
|
|
|
Examples contain scripts to help you quickly get started using BigDL-LLM to run some popular open-source models in the community.
|
|
|
|
+++
|
|
|
|
:bdg-link:`Examples <./Overview/examples.html>`
|
|
|
|
.. grid-item-card::
|
|
|
|
**API Document**
|
|
^^^
|
|
|
|
API Document provides detailed description of BigDL-LLM APIs.
|
|
|
|
+++
|
|
|
|
:bdg-link:`API Document <../PythonAPI/LLM/index.html>`
|
|
|
|
------
|
|
|
|
.. raw:: html
|
|
|
|
<div>
|
|
<p>
|
|
<sup><a href="#ref-perf" id="footnote-perf">[1]</a>
|
|
Performance varies by use, configuration and other factors. <code><span>bigdl-llm</span></code> may not optimize to the same degree for non-Intel products. Learn more at <a href="https://www.Intel.com/PerformanceIndex">www.Intel.com/PerformanceIndex</a>.
|
|
</sup>
|
|
</p>
|
|
</div>
|
|
|
|
.. toctree::
|
|
:hidden:
|
|
|
|
BigDL-LLM Document <self>
|