Commit graph

177 commits

Author SHA1 Message Date
Jason Dai
e2233dddef Update README (#10111) 2024-02-06 19:29:07 +08:00
Jason Dai
f440cb4fba Update Self-Speculative Decoding Readme (#10102) 2024-02-06 12:59:17 +08:00
binbin Deng
91cf9d41d0 LLM: add solutions of some frequently asked questions (#10068) 2024-02-04 09:28:20 +08:00
binbin Deng
4b92235bdb LLM: add initial FAQ page (#10055) 2024-02-01 09:43:39 +08:00
Yuwen Hu
175027c90f Small clarification for windows installation guide (#10002) 2024-01-25 18:39:11 +08:00
Mingyu Wei
bc9cff51a8 LLM GPU Example Update for Windows Support (#9902)
* Update README in LLM GPU Examples

* Update reference of Intel GPU

* add cpu_embedding=True in comment

* small fixes

* update GPU/README.md and add explanation for cpu_embedding=True

* address comments

* fix small typos

* add backtick for cpu_embedding=True

* remove extra backtick in the doc

* add period mark

* update readme
2024-01-24 13:42:27 +08:00
Cheen Hau, 俊豪
e403e4a8b7 Add APT install instructions for oneAPI (#9875)
* Add APT installer

* Include reviewer suggestions

* Add note - ensure matching version of oneAPI and pytorch/ipex

* Fix 'command line installer'

* Fix formatting. Address review comments

* Append ':' to '..by running the following commands'

* Fix formatting

* achieve -> archive
2024-01-17 17:30:30 +08:00
Yuwen Hu
0aef35a965 [LLM] Improve LLM doc regarding windows gpu related info (#9880)
* Improve runtime configuration for windows

* Add python 310/311 supports for wheel downloading

* Add troubleshooting for windows gpu

* Remove manually import ipex due to auto importer

* Add info regarding cpu_embedding=True on iGPU

* More info for Windows users

* Small updates to API docs

* Python style fix

* Remove tip for loading from saved optimize_model for now

* Updated based on comments

* Update win info for multi-intel gpus selection

* Small fix

* Small fix
2024-01-11 14:37:16 +08:00
Cheen Hau, 俊豪
b2aa267f50 Enhance LLM GPU installation document (#9828)
* Improve gpu install doc

* Add troubleshooting - setvars.sh not done properly.

* Further improvements

* 2024.x.x -> 2024.0

* Fixes

* Fix Install BigDL-LLM From Wheel : bigdl-llm[xpu_2.0]

* Remove "export USE_XETLA=OFF" for Max GPU
2024-01-09 16:30:50 +08:00
Yuwen Hu
5ba1dc38d4 [LLM] Change default Linux GPU install option to PyTorch 2.1 (#9858)
* Update default xpu to ipex 2.1

* Update related install ut support correspondingly

* Add arc ut tests for both ipex 2.0 and 2.1

* Small fix

* Diable ipex 2.1 test for now as oneapi 2024.0 has not beed installed on the test machine

* Update document for default PyTorch 2.1

* Small fix

* Small fix

* Small doc fixes

* Small fixes
2024-01-08 17:16:17 +08:00
Yishuo Wang
5c6543e070 Reorganize LLM GPU installation document (#9777) 2024-01-03 13:53:05 +08:00
Xin Qiu
95c03765cb Update install_gpu.md, remove kernel 5.19 requirement. (#9757)
* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Small fixes

---------

Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
2023-12-22 16:17:56 +08:00
Yuwen Hu
c00a9144c4 [LLM] Small fixes to llm gpu installation guide (#9700) 2023-12-15 23:13:33 +08:00
Yuwen Hu
68d0c255fc [LLM] Update GPU installation doc (#9693)
* Temp

* Add win 2.1 doc supports

* Reorg layout

* Fix based on comments

* Small fix
2023-12-14 18:32:51 +08:00
Yining Wang
a04a027b4c Edit gpu doc (#9583)
* harness: run llama2-7b

* harness: run llama2-7b

* harness: run llama2-7b

* harness: run llama2-7b

* edit-gpu-doc

* fix some format problem

* fix spelling problems

* fix evaluation yml

* delete redundant space

* fix some problems

* address comments

* change link
2023-12-11 14:59:07 +08:00
Xin Qiu
32b37f3af7 Update gpu install.md (#9541)
* Update install_gpu.md

* Update install_gpu.md
2023-11-28 11:15:03 +08:00
Xin Qiu
0f9a440b06 doc for Multi gpu selection (#9414) 2023-11-20 09:25:58 +08:00
binbin Deng
db37edae8a LLM: update langchain api document page (#9222) 2023-10-24 10:13:41 +08:00
binbin Deng
7e96d3e79a LLM: improve gpu supports key feature doc page (#9212) 2023-10-19 18:40:48 +08:00
binbin Deng
efcda3892f LLM: add save & load usage in PyTorch API key feature page (#9183) 2023-10-17 17:24:51 +08:00
binbin Deng
330e67e2c0 LLM: update example doc page (#9186) 2023-10-17 16:26:11 +08:00
binbin Deng
760183bac6 LLM: update key feature and installation page of document (#9068) 2023-09-27 15:44:34 +08:00
Yuwen Hu
cb534ed5c4 [LLM] Add Arc demo gif to readme and readthedocs (#8958)
* Add arc demo in main readme

* Small style fix

* Realize using table

* Update based on comments

* Small update

* Try to solve with height problem

* Small fix

* Update demo for inner llm readme

* Update demo video for readthedocs

* Small fix

* Update based on comments
2023-09-13 09:23:52 +08:00
Yuwen Hu
3d1c7e7082 Small link fix (#8910) 2023-09-07 13:35:29 +08:00
Yuwen Hu
cf6a620bae [LLM] BigDL-LLM Documentation Initial Version (#8833)
* Change order of LLM in header

* Some updates to footer

* Add BigDL-LLM index page and basic file structure

* Update index page for key features

* Add initial content for BigDL-LLM in 5 mins

* Improvement to footnote

* Add initial contents based on current contents we have

* Add initial quick links

* Small fix

* Rename file

* Hide cli section for now and change model supports to examples

* Hugging Face format -> Hugging Face transformers format

* Add placeholder for GPU supports

* Add GPU related content structure

* Add cpu/gpu installation initial contents

* Add initial contents for GPU supports

* Add image link to LLM index page

* Hide tips and known issues for now

* Small fix

* Update based on comments

* Small fix

* Add notes for Python 3.9

* Add placehoder optimize model & reveal CLI; small revision

* examples add gpu part

* Hide CLI part again for first version of merging

* add keyfeatures-optimize_model part (#1)

* change gif link to the ones hosted on github

* Small fix

---------

Co-authored-by: plusbang <binbin1.deng@intel.com>
Co-authored-by: binbin Deng <108676127+plusbang@users.noreply.github.com>
2023-09-06 15:38:45 +08:00
Kai Huang
4573ff7ffe Update llm api doc (#8712)
* change to bigdlllm

* update
2023-08-10 12:17:19 +08:00
Kai Huang
1b65288bdb Add api doc for LLM (#8605)
* api doc initial

* update desc
2023-08-08 18:17:16 +08:00