33 lines
1 KiB
ReStructuredText
33 lines
1 KiB
ReStructuredText
BigDL-LLM Key Features
|
|
================================
|
|
|
|
You may run the LLMs using ``bigdl-llm`` through one of the following APIs:
|
|
|
|
* `PyTorch API <./optimize_model.html>`_
|
|
* |transformers_style_api|_
|
|
|
|
* |hugging_face_transformers_format|_
|
|
* `Native Format <./native_format.html>`_
|
|
|
|
* `LangChain API <./langchain_api.html>`_
|
|
* |gpu_supports|_
|
|
|
|
* |inference_on_gpu|_
|
|
* `Finetune (QLoRA) <./finetune.html>`_
|
|
* `Multi GPUs selection <./multi_gpus_selection.html>`_
|
|
|
|
|
|
.. |transformers_style_api| replace:: ``transformers``-style API
|
|
.. _transformers_style_api: ./transformers_style_api.html
|
|
|
|
.. |hugging_face_transformers_format| replace:: Hugging Face ``transformers`` Format
|
|
.. _hugging_face_transformers_format: ./hugging_face_format.html
|
|
|
|
.. |gpu_supports| replace:: GPU Supports
|
|
.. _gpu_supports: ./gpu_supports.html
|
|
|
|
.. |inference_on_gpu| replace:: Inference on GPU
|
|
.. _inference_on_gpu: ./inference_on_gpu.html
|
|
|
|
.. |multi_gpus_selection| replace:: Multi GPUs selection
|
|
.. _multi_gpus_selection: ./multi_gpus_selection.html
|