Dongjie Shi
c4dbd21cfc
update readthedocs project name ( #10519 )
...
* update readthedocs project name
* update readthedocs project name
2024-03-25 11:44:35 +08:00
Wang, Jian4
16b2ef49c6
Update_document by heyang ( #30 )
2024-03-25 10:06:02 +08:00
Wang, Jian4
9df70d95eb
Refactor bigdl.llm to ipex_llm ( #24 )
...
* Rename bigdl/llm to ipex_llm
* rm python/llm/src/bigdl
* from bigdl.llm to from ipex_llm
2024-03-22 15:41:21 +08:00
Ruonan Wang
a7da61925f
LLM: add windows related info in llama-cpp quickstart ( #10505 )
...
* first commit
* update
* add image, update Prerequisites
* small fix
2024-03-22 13:51:14 +08:00
Cheen Hau, 俊豪
a7d38bee94
WebUI quickstart: add instruct chat mode and tested models ( #10436 )
...
* Add instruct chat mode and tested models
* Fix table
* Remove falcon from 'tested models'
* Fixes
* Open image in new window
2024-03-21 20:15:32 +08:00
Kai Huang
92ee2077b3
Update Linux Quickstart ( #10499 )
...
* fix quick start
* update toc
* expose docker
2024-03-21 20:13:21 +08:00
Ruonan Wang
8d0ea1b9b3
LLM: add initial QuickStart for linux cpp usage ( #10418 )
...
* add first version
* update content and add link
* --amend
* update based on new usage
* update usage based on new pr
* temp save
* basic stable version
* change to backend
2024-03-21 17:35:58 +08:00
Yuxuan Xia
3d59c74a0b
Linux quick start ( #10391 )
...
* Fix Baichuan2 prompt format
* Add linux quick start guide
* Modify the linux installation quick start
* Adjust Linux quick start
* Adjust Linux quick start
* Add linux quick start screenshots
* Revert Baichuan2 changes
* Fix linux quick start typo
* Fix linux quick start typos
* Remove linux quick start downgrade kernel
* Change linux quick start bigdl install
* Modify linux quick start
2024-03-21 16:02:29 +08:00
hxsz1997
158a49986a
Add quickstart for install bigdl-llm in docker on windows with Intel GPU ( #10421 )
...
* add quickstart for install bigdl in docker on window with Intel GPU
* modify the inference command
* add note of required disk space
* add the issue of iGPU
2024-03-21 15:57:27 +08:00
Shengsheng Huang
e25d7413de
add prerequisite section in quickstart ( #10460 )
...
* add prerequisite section
* fix typo
2024-03-19 14:24:51 +08:00
Cheen Hau, 俊豪
9880ddfc17
Update WebUI quickstart ( #10316 )
...
* Enlarge images and make them clickable to open in new window
* Update text to match image
* Remove image for 'AttributeError' since it does not show the error
* Add note on slower first response
* 'gpu models' -> 'gpu types'
2024-03-13 17:59:55 +08:00
Lilac09
aec83a8be6
Fix user guide indent ( #10393 )
2024-03-13 09:49:07 +08:00
Jin Qiao
c2fb17bd43
LLM: update quickstart Windows gpu install guide & other quickstart doc style ( #10365 )
...
* init
* fix doc style, add modelscope and tutorial
* fix web ui doc style
* add exit way
* fix
* fix modelscope note
* fix according to comment
* fix according to comment
* fix
* fix according to comments
* fix
* fix
* fix
* fix style
* try fix
* fix
* fix
* Small updates
---------
Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
2024-03-12 18:38:35 +08:00
Lilac09
5809a3f5fe
Add run-hbm.sh & add user guide for spr and hbm ( #10357 )
...
* add run-hbm.sh
* add spr and hbm guide
* only support quad mode
* only support quad mode
* update special cases
* update special cases
2024-03-12 16:15:27 +08:00
WeiguangHan
cac96b00be
LLM: Small fix for benchmark userguide ( #10373 )
...
* small fix for benchmark userguide
* resolve some comments
2024-03-12 12:26:26 +08:00
Jason Dai
490cbcc897
Update readme ( #10378 )
2024-03-12 11:53:03 +08:00
WeiguangHan
f4cef95690
LLM: some slight modification to benchmark user guide ( #10347 )
2024-03-08 19:43:12 +08:00
Cheen Hau, 俊豪
6829efd350
Change quickstart documentation to use oneapi offline installer ( #10350 )
...
* Change to oneapi offline installer
* Fixes
* Add "call"
* Fixes
2024-03-08 19:24:00 +08:00
WeiguangHan
db00e79cdf
LLM: add user guide for benchmarking ( #10284 )
...
* add user guide for benchmarking
* change the name and place of the benchmark user guide
* resolve some comments
* resolve new comments
* modify some typo
* resolve some new comments
* modify some descriptions
2024-03-07 18:50:29 +08:00
Yuwen Hu
fa69fed58f
Small fixes to oneAPI link ( #10339 )
2024-03-07 09:56:04 +08:00
Yuwen Hu
566e9bbb36
[LLM Doc] Restructure ( #10322 )
...
* Add quick link guide to sidebar
* Add QuickStart to TOC
* Update quick links in main page
* Hide some section in More for top nav bar
* Resturct FAQ sections
* Small fix
2024-03-05 14:35:55 +08:00
Xin Qiu
58208a5883
Update FAQ document. ( #10300 )
...
* Update install_gpu.md
* Update resolve_error.md
* Update README.md
* Update resolve_error.md
* Update README.md
* Update resolve_error.md
2024-03-04 08:35:11 +08:00
Jason Dai
4cb4db618d
Update WebUI quickstart ( #10305 )
2024-03-03 22:18:26 +08:00
Jason Dai
367b1db4f7
Update readme ( #10303 )
2024-03-01 17:37:14 +08:00
Shengsheng Huang
1db20dd1d0
add warmup advice in quickstart ( #10293 )
2024-03-01 17:15:45 +08:00
Xin Qiu
509e206de0
update doc about gemma random and unreadable output. ( #10297 )
...
* Update install_gpu.md
* Update README.md
* Update README.md
2024-03-01 15:41:16 +08:00
Shengsheng Huang
90f2f82638
revise webui quickstart ( #10287 )
2024-03-01 10:04:21 +08:00
Jason Dai
14814abab8
Update README.md ( #10286 )
2024-02-29 20:00:53 +08:00
Cheen Hau, 俊豪
653cb500ed
Add webUI quickstart ( #10266 )
...
* Add webUI quickstart
* Add GPU driver install
* Move images to readthedocs assets
2024-02-29 10:08:06 +08:00
Jason Dai
1572b6f7c3
Add quickstart ( #10272 )
2024-02-29 08:46:43 +08:00
Shengsheng Huang
b88f447974
fix typo and change wording ( #10254 )
2024-02-27 13:40:51 +08:00
Shengsheng Huang
04a6b0040c
Windows GPU Install Quickstart update ( #10240 )
...
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* fix numbering
* Update install_windows_gpu.md
* Update install_windows_gpu.md
2024-02-27 13:14:39 +08:00
Zhicun
7c236e4c6d
quick start for windows with gpu ( #10221 )
...
* quick start for windows igpu
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* update the demo.py
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* fix image position typo
* Update install_windows_gpu.md
* update pip install command
---------
Co-authored-by: Shengsheng Huang <shannie.huang@gmail.com>
2024-02-26 12:19:36 +08:00
Jason Dai
40584dec6d
Update readme ( #10214 )
2024-02-23 11:42:16 +08:00
Jason Dai
84d5f40936
Update README.md ( #10213 )
2024-02-22 17:22:59 +08:00
Yuwen Hu
94cb16fe40
[LLM] Small updates to Win GPU Install Doc ( #10199 )
...
* Make Offline installer as default for win gpu doc for oneAPI
* Small other fixes
2024-02-21 17:58:40 +08:00
Jason Dai
4655005f24
Update README ( #10186 )
2024-02-21 16:35:52 +08:00
hxsz1997
6e10d98a8d
Fix some typos ( #10175 )
...
* add llm-ppl workflow
* update the DATASET_DIR
* test multiple precisions
* modify nightly test
* match the updated ppl code
* add matrix.include
* fix the include error
* update the include
* add more model
* update the precision of include
* update nightly time and add more models
* fix the workflow_dispatch description, change default model of pr and modify the env
* modify workflow_dispatch language options
* modify options
* modify language options
* modeify workflow_dispatch type
* modify type
* modify the type of language
* change seq_len type
* fix some typos
* revert changes to stress_test.txt
2024-02-20 14:14:53 +08:00
Cheen Hau, 俊豪
6952847f68
GPU install doc - add pip install oneAPI for windows ( #10157 )
...
* Add instructions for pip install oneAPI for windows
* Improve clarity
* Format fix
* Fix
* Fix in runtime configuration
2024-02-19 14:46:08 +08:00
Kai Huang
7400401706
Update gpu pip install oneapi doc ( #10137 )
...
* fix link
* fix
* fix
* minor
2024-02-09 11:27:40 +08:00
Cheen Hau, 俊豪
a7f9a13f6e
Enhance gpu doc with PIP install oneAPI ( #10109 )
...
* Add pip install oneapi instructions
* Fixes
* Add instruction for oneapi2023
* Runtime config
* Fixes
* Remove "Currently, oneAPI installed with .. "
* Add pip package version for oneAPI 2024
* Reviewer comments
* Fix errors
2024-02-07 21:14:15 +08:00
binbin Deng
c1ec3d8921
LLM: update FAQ about too many open files ( #10119 )
2024-02-07 15:02:24 +08:00
Jason Dai
e2233dddef
Update README ( #10111 )
2024-02-06 19:29:07 +08:00
Jason Dai
f440cb4fba
Update Self-Speculative Decoding Readme ( #10102 )
2024-02-06 12:59:17 +08:00
binbin Deng
91cf9d41d0
LLM: add solutions of some frequently asked questions ( #10068 )
2024-02-04 09:28:20 +08:00
Jason Dai
2927c77d7f
Update readme ( #10071 )
2024-02-01 20:40:20 -08:00
binbin Deng
4b92235bdb
LLM: add initial FAQ page ( #10055 )
2024-02-01 09:43:39 +08:00
Shaojun Liu
2a0d65a009
Bump aiohttp from 3.9.0 to 3.9.2 to resolve security issues ( #10030 )
...
* Bump aiohttp from 3.9.0 to 3.9.2 to resolve security issues
* update url
* remove aiohttp version from requirements.txt
* revert aiohttp to 3.9.0
* trigger tests
* revert
2024-01-30 19:36:02 +08:00
Yuwen Hu
a5c9dfdf91
[LLM] Main readme gpu installation related updates ( #9868 )
...
* Main readme gpu installation related updates
* Small updates for readthedocs main page
2024-01-29 16:33:27 +08:00
binbin Deng
171fb2d185
LLM: reorganize GPU finetuning examples ( #9952 )
2024-01-25 19:02:38 +08:00
Yuwen Hu
175027c90f
Small clarification for windows installation guide ( #10002 )
2024-01-25 18:39:11 +08:00
Mingyu Wei
bc9cff51a8
LLM GPU Example Update for Windows Support ( #9902 )
...
* Update README in LLM GPU Examples
* Update reference of Intel GPU
* add cpu_embedding=True in comment
* small fixes
* update GPU/README.md and add explanation for cpu_embedding=True
* address comments
* fix small typos
* add backtick for cpu_embedding=True
* remove extra backtick in the doc
* add period mark
* update readme
2024-01-24 13:42:27 +08:00
Cheen Hau, 俊豪
e403e4a8b7
Add APT install instructions for oneAPI ( #9875 )
...
* Add APT installer
* Include reviewer suggestions
* Add note - ensure matching version of oneAPI and pytorch/ipex
* Fix 'command line installer'
* Fix formatting. Address review comments
* Append ':' to '..by running the following commands'
* Fix formatting
* achieve -> archive
2024-01-17 17:30:30 +08:00
Yuwen Hu
0aef35a965
[LLM] Improve LLM doc regarding windows gpu related info ( #9880 )
...
* Improve runtime configuration for windows
* Add python 310/311 supports for wheel downloading
* Add troubleshooting for windows gpu
* Remove manually import ipex due to auto importer
* Add info regarding cpu_embedding=True on iGPU
* More info for Windows users
* Small updates to API docs
* Python style fix
* Remove tip for loading from saved optimize_model for now
* Updated based on comments
* Update win info for multi-intel gpus selection
* Small fix
* Small fix
2024-01-11 14:37:16 +08:00
Kai Huang
5e766e8105
Fix Mixtral typo ( #9882 )
2024-01-10 19:51:24 +08:00
Kai Huang
b53a5cb6c9
Fix Mixtral typo ( #9881 )
...
* fix typo
* fix doc page
2024-01-10 19:40:52 +08:00
Yuwen Hu
200fc6a1ee
[LLM] Fix llm api doc rendering failure due to ipex auto importer ( #9877 )
2024-01-10 14:53:25 +08:00
Cheen Hau, 俊豪
b2aa267f50
Enhance LLM GPU installation document ( #9828 )
...
* Improve gpu install doc
* Add troubleshooting - setvars.sh not done properly.
* Further improvements
* 2024.x.x -> 2024.0
* Fixes
* Fix Install BigDL-LLM From Wheel : bigdl-llm[xpu_2.0]
* Remove "export USE_XETLA=OFF" for Max GPU
2024-01-09 16:30:50 +08:00
Jason Dai
a3725b0816
Update readme ( #9865 )
2024-01-09 15:19:42 +08:00
Yuwen Hu
5ba1dc38d4
[LLM] Change default Linux GPU install option to PyTorch 2.1 ( #9858 )
...
* Update default xpu to ipex 2.1
* Update related install ut support correspondingly
* Add arc ut tests for both ipex 2.0 and 2.1
* Small fix
* Diable ipex 2.1 test for now as oneapi 2024.0 has not beed installed on the test machine
* Update document for default PyTorch 2.1
* Small fix
* Small fix
* Small doc fixes
* Small fixes
2024-01-08 17:16:17 +08:00
Kai Huang
62a3c0fc16
Fix quick build doc ( #9853 )
2024-01-08 14:26:34 +08:00
Yishuo Wang
5c6543e070
Reorganize LLM GPU installation document ( #9777 )
2024-01-03 13:53:05 +08:00
Jason Dai
3ab3105bab
Update readme ( #9816 )
2024-01-03 12:07:00 +08:00
Jason Dai
361781bcd0
Update readme ( #9788 )
2023-12-26 19:46:11 +08:00
Xin Qiu
95c03765cb
Update install_gpu.md, remove kernel 5.19 requirement. ( #9757 )
...
* Update install_gpu.md
* Update install_gpu.md
* Update install_gpu.md
* Update install_gpu.md
* Update install_gpu.md
* Update install_gpu.md
* Update install_gpu.md
* Update install_gpu.md
* Update install_gpu.md
* Small fixes
---------
Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
2023-12-22 16:17:56 +08:00
Yuwen Hu
c00a9144c4
[LLM] Small fixes to llm gpu installation guide ( #9700 )
2023-12-15 23:13:33 +08:00
Jason Dai
37f509bb95
Update readme ( #9692 )
2023-12-14 19:50:21 +08:00
Yuwen Hu
68d0c255fc
[LLM] Update GPU installation doc ( #9693 )
...
* Temp
* Add win 2.1 doc supports
* Reorg layout
* Fix based on comments
* Small fix
2023-12-14 18:32:51 +08:00
Yining Wang
a04a027b4c
Edit gpu doc ( #9583 )
...
* harness: run llama2-7b
* harness: run llama2-7b
* harness: run llama2-7b
* harness: run llama2-7b
* edit-gpu-doc
* fix some format problem
* fix spelling problems
* fix evaluation yml
* delete redundant space
* fix some problems
* address comments
* change link
2023-12-11 14:59:07 +08:00
Jason Dai
84a19705a6
Update readme ( #9617 )
2023-12-09 19:23:14 +08:00
Kai Huang
f7e596d85a
Update doc ( #9580 )
...
* update aiohttp in docs
* update doc
2023-12-01 15:40:37 +08:00
Jason Dai
bda404fc8f
Update readme ( #9575 )
2023-11-30 22:45:52 +08:00
Xin Qiu
32b37f3af7
Update gpu install.md ( #9541 )
...
* Update install_gpu.md
* Update install_gpu.md
2023-11-28 11:15:03 +08:00
Xin Qiu
0f9a440b06
doc for Multi gpu selection ( #9414 )
2023-11-20 09:25:58 +08:00
Shaojun Liu
8c603014ac
update 2.5.0-snapshot readthedoc ( #9440 )
2023-11-13 16:31:43 +08:00
Jason Dai
11a05641a4
Update readme ( #9348 )
2023-11-03 11:27:07 +08:00
binbin Deng
db37edae8a
LLM: update langchain api document page ( #9222 )
2023-10-24 10:13:41 +08:00
Jason Dai
26850ebd36
Update readme ( #9237 )
2023-10-20 16:13:25 +08:00
binbin Deng
7e96d3e79a
LLM: improve gpu supports key feature doc page ( #9212 )
2023-10-19 18:40:48 +08:00
binbin Deng
efcda3892f
LLM: add save & load usage in PyTorch API key feature page ( #9183 )
2023-10-17 17:24:51 +08:00
binbin Deng
330e67e2c0
LLM: update example doc page ( #9186 )
2023-10-17 16:26:11 +08:00
binbin Deng
eb3fb18eb4
LLM: improve PyTorch API doc ( #9128 )
2023-10-11 15:03:39 +08:00
binbin Deng
e4d1457a70
LLM: improve transformers style API doc ( #9113 )
2023-10-10 09:31:00 +08:00
Jason Dai
7506100bd5
Update readme ( #9084 )
2023-10-05 16:54:09 +08:00
binbin Deng
760183bac6
LLM: update key feature and installation page of document ( #9068 )
2023-09-27 15:44:34 +08:00
Jason Dai
51518e029d
Update llm readme ( #9005 )
2023-09-19 20:01:33 +08:00
Yuwen Hu
cb534ed5c4
[LLM] Add Arc demo gif to readme and readthedocs ( #8958 )
...
* Add arc demo in main readme
* Small style fix
* Realize using table
* Update based on comments
* Small update
* Try to solve with height problem
* Small fix
* Update demo for inner llm readme
* Update demo video for readthedocs
* Small fix
* Update based on comments
2023-09-13 09:23:52 +08:00
Jason Dai
448a9e813a
Update Readme ( #8959 )
2023-09-12 17:27:26 +08:00
Yuwen Hu
3d1c7e7082
Small link fix ( #8910 )
2023-09-07 13:35:29 +08:00
SONG Ge
7a71ced78f
[LLM Docs] Remain API Docs Issues Solution ( #8780 )
...
* langchain readthedocs update
* solve langchain.llms.transformersllm issues
* langchain.embeddings.transformersembeddings/transfortmersllms issues
* update docs for get_num_tokens
* add low_bit api doc
* add optimizer model api doc
* update rst index
* fix coomments style
* update docs following the comments
* update api doc
2023-09-06 16:29:34 +08:00
Yuwen Hu
cf6a620bae
[LLM] BigDL-LLM Documentation Initial Version ( #8833 )
...
* Change order of LLM in header
* Some updates to footer
* Add BigDL-LLM index page and basic file structure
* Update index page for key features
* Add initial content for BigDL-LLM in 5 mins
* Improvement to footnote
* Add initial contents based on current contents we have
* Add initial quick links
* Small fix
* Rename file
* Hide cli section for now and change model supports to examples
* Hugging Face format -> Hugging Face transformers format
* Add placeholder for GPU supports
* Add GPU related content structure
* Add cpu/gpu installation initial contents
* Add initial contents for GPU supports
* Add image link to LLM index page
* Hide tips and known issues for now
* Small fix
* Update based on comments
* Small fix
* Add notes for Python 3.9
* Add placehoder optimize model & reveal CLI; small revision
* examples add gpu part
* Hide CLI part again for first version of merging
* add keyfeatures-optimize_model part (#1 )
* change gif link to the ones hosted on github
* Small fix
---------
Co-authored-by: plusbang <binbin1.deng@intel.com>
Co-authored-by: binbin Deng <108676127+plusbang@users.noreply.github.com>
2023-09-06 15:38:45 +08:00
Jiao Wang
14b95ebfb4
Update Databricks documentation for Pytorch Estimator issue ( #8869 )
...
* update doc
* add image
* update
2023-09-05 12:59:47 -07:00
Jason Dai
5e58f698cd
Update readthedocs ( #8882 )
2023-09-04 15:42:16 +08:00
Jason Dai
9760eec6de
Update readme ( #8881 )
2023-09-03 12:30:26 +08:00
Jiao Wang
5d90ca2dac
Update MPI Estimator to support Pytorch IPEX training ( #8303 )
...
* update
* update
* update
* update
* update
* update with comments
* update
* update
* style
* style
* add doc
* style
* style
2023-08-28 11:03:29 -07:00
Jason Dai
dcadd09154
Update llm document ( #8784 )
2023-08-21 22:34:44 +08:00
SONG Ge
f4164e4492
[BigDL LLM] Update readme for unifying transformers API ( #8737 )
...
* update readme doc
* fix readthedocs error
* update comment
* update exception error info
* invalidInputError instead
* fix readme typo error and remove import error
* fix more typo
2023-08-16 14:22:32 +08:00
Kai Huang
4573ff7ffe
Update llm api doc ( #8712 )
...
* change to bigdlllm
* update
2023-08-10 12:17:19 +08:00
Kai Huang
1b65288bdb
Add api doc for LLM ( #8605 )
...
* api doc initial
* update desc
2023-08-08 18:17:16 +08:00
Yuwen Hu
06ed70fa43
Update google site verification for readthedocs ( #8689 )
2023-08-04 16:05:28 +08:00
