ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Add quickstart (#10272)

Browse source
This commit is contained in:
Jason Dai 2024-02-29 08:46:43 +08:00 committed by GitHub
parent 925aff730e
commit 1572b6f7c3
2 changed files with 8 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
README.md
View file

@ -62,10 +62,12 @@ See the ***optimized performance*** of `chatglm2-6b` and `llama-2-13b-chat` mode
### `bigdl-llm` quickstart ### `bigdl-llm` quickstart
- [Windows GPU installation](https://test-bigdl-llm.readthedocs.io/en/main/doc/LLM/Quickstart/install_windows_gpu.html)
- [Run BigDL-LLM using Docker](docker/llm)
- [CPU INT4](#cpu-int4) - [CPU INT4](#cpu-int4)
- [GPU INT4](#gpu-int4) - [GPU INT4](#gpu-int4)
- [More Low-Bit Support](#more-low-bit-support) - [More Low-Bit support](#more-low-bit-support)
- [Verified Models](#verified-models) - [Verified models](#verified-models)
#### CPU INT4 #### CPU INT4
##### Install ##### Install

6
docs/readthedocs/source/index.rst
View file

@ -81,8 +81,10 @@ See the **optimized performance** of ``chatglm2-6b`` and ``llama-2-13b-chat`` mo
``bigdl-llm`` quickstart ``bigdl-llm`` quickstart
============================================ ============================================
- `CPU <#cpu-quickstart>`_ - `Windows GPU installation <doc/LLM/Quickstart/install_windows_gpu.html>`_
- `GPU <#gpu-quickstart>`_ - `Run BigDL-LLM using Docker <https://github.com/intel-analytics/BigDL/tree/main/docker/llm>`_
- `CPU quickstart <#cpu-quickstart>`_
- `GPU quickstart <#gpu-quickstart>`_
-------------------------------------------- --------------------------------------------
CPU Quickstart CPU Quickstart