Kai Huang
e619142a16
Add SYCL_CACHE_PERSISTENT in doc and explain warmup in benchmark quickstart ( #10571 )
...
* update doc
* update
2024-03-27 21:03:51 +08:00
Yuwen Hu
1bae5f40d2
Hide pip installer for windows install ( #10568 )
...
* Hide oneAPI install with pip installer for now
* Small fix
2024-03-27 18:41:41 +08:00
Cheen Hau, 俊豪
f239bc329b
Specify oneAPI minor version in documentation ( #10561 )
2024-03-27 17:58:57 +08:00
Yuwen Hu
c182acef3f
[Doc] Update IPEX-LLM Index Page ( #10534 )
...
* Update readthedocs readme before Latest Update
* Update before quick start section in index page
* Update quickstart section
* Further updates for Code Example
* Small fix
* Small fix
* Fix migration guide style
2024-03-25 18:43:32 +08:00
Yuwen Hu
e0ea7b8244
[Doc] IPEX-LLM Doc Layout Update ( #10532 )
...
* Fix navigation bar to 1
* Remove unnecessary python api
* Fixed failed langchain native api doc
* Change index page layout
* Update quicklink for IPEX-LLM
* Simplify toc and add bigdl-llm migration guide
* Update readthedocs readme
* Add missing index link for bigdl-llm migration guide
* Update logo image and repo link
* Update copyright
* Small fix
* Update copyright
* Update top nav bar
* Small fix
2024-03-25 16:23:56 +08:00
Shengsheng Huang
de5bbf83de
update linux quickstart and formats of migration ( #10530 )
...
* update linux quickstart and formats of migration
* update quickstart
* update format
2024-03-25 15:38:02 +08:00
Jason Dai
5b76f88a8f
Update README.md ( #10518 )
2024-03-25 13:37:01 +08:00
Shengsheng Huang
d7d0e66b18
move migration guide to quickstart ( #10521 )
2024-03-25 11:50:49 +08:00
Wang, Jian4
16b2ef49c6
Update_document by heyang ( #30 )
2024-03-25 10:06:02 +08:00
Wang, Jian4
9df70d95eb
Refactor bigdl.llm to ipex_llm ( #24 )
...
* Rename bigdl/llm to ipex_llm
* rm python/llm/src/bigdl
* from bigdl.llm to from ipex_llm
2024-03-22 15:41:21 +08:00
Ruonan Wang
a7da61925f
LLM: add windows related info in llama-cpp quickstart ( #10505 )
...
* first commit
* update
* add image, update Prerequisites
* small fix
2024-03-22 13:51:14 +08:00
Cheen Hau, 俊豪
a7d38bee94
WebUI quickstart: add instruct chat mode and tested models ( #10436 )
...
* Add instruct chat mode and tested models
* Fix table
* Remove falcon from 'tested models'
* Fixes
* Open image in new window
2024-03-21 20:15:32 +08:00
Kai Huang
92ee2077b3
Update Linux Quickstart ( #10499 )
...
* fix quick start
* update toc
* expose docker
2024-03-21 20:13:21 +08:00
Ruonan Wang
8d0ea1b9b3
LLM: add initial QuickStart for linux cpp usage ( #10418 )
...
* add first version
* update content and add link
* --amend
* update based on new usage
* update usage based on new pr
* temp save
* basic stable version
* change to backend
2024-03-21 17:35:58 +08:00
Yuxuan Xia
3d59c74a0b
Linux quick start ( #10391 )
...
* Fix Baichuan2 prompt format
* Add linux quick start guide
* Modify the linux installation quick start
* Adjust Linux quick start
* Adjust Linux quick start
* Add linux quick start screenshots
* Revert Baichuan2 changes
* Fix linux quick start typo
* Fix linux quick start typos
* Remove linux quick start downgrade kernel
* Change linux quick start bigdl install
* Modify linux quick start
2024-03-21 16:02:29 +08:00
hxsz1997
158a49986a
Add quickstart for install bigdl-llm in docker on windows with Intel GPU ( #10421 )
...
* add quickstart for install bigdl in docker on window with Intel GPU
* modify the inference command
* add note of required disk space
* add the issue of iGPU
2024-03-21 15:57:27 +08:00
Shengsheng Huang
e25d7413de
add prerequisite section in quickstart ( #10460 )
...
* add prerequisite section
* fix typo
2024-03-19 14:24:51 +08:00
Cheen Hau, 俊豪
9880ddfc17
Update WebUI quickstart ( #10316 )
...
* Enlarge images and make them clickable to open in new window
* Update text to match image
* Remove image for 'AttributeError' since it does not show the error
* Add note on slower first response
* 'gpu models' -> 'gpu types'
2024-03-13 17:59:55 +08:00
Lilac09
aec83a8be6
Fix user guide indent ( #10393 )
2024-03-13 09:49:07 +08:00
Jin Qiao
c2fb17bd43
LLM: update quickstart Windows gpu install guide & other quickstart doc style ( #10365 )
...
* init
* fix doc style, add modelscope and tutorial
* fix web ui doc style
* add exit way
* fix
* fix modelscope note
* fix according to comment
* fix according to comment
* fix
* fix according to comments
* fix
* fix
* fix
* fix style
* try fix
* fix
* fix
* Small updates
---------
Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
2024-03-12 18:38:35 +08:00
Lilac09
5809a3f5fe
Add run-hbm.sh & add user guide for spr and hbm ( #10357 )
...
* add run-hbm.sh
* add spr and hbm guide
* only support quad mode
* only support quad mode
* update special cases
* update special cases
2024-03-12 16:15:27 +08:00
WeiguangHan
cac96b00be
LLM: Small fix for benchmark userguide ( #10373 )
...
* small fix for benchmark userguide
* resolve some comments
2024-03-12 12:26:26 +08:00
WeiguangHan
f4cef95690
LLM: some slight modification to benchmark user guide ( #10347 )
2024-03-08 19:43:12 +08:00
Cheen Hau, 俊豪
6829efd350
Change quickstart documentation to use oneapi offline installer ( #10350 )
...
* Change to oneapi offline installer
* Fixes
* Add "call"
* Fixes
2024-03-08 19:24:00 +08:00
WeiguangHan
db00e79cdf
LLM: add user guide for benchmarking ( #10284 )
...
* add user guide for benchmarking
* change the name and place of the benchmark user guide
* resolve some comments
* resolve new comments
* modify some typo
* resolve some new comments
* modify some descriptions
2024-03-07 18:50:29 +08:00
Yuwen Hu
fa69fed58f
Small fixes to oneAPI link ( #10339 )
2024-03-07 09:56:04 +08:00
Yuwen Hu
566e9bbb36
[LLM Doc] Restructure ( #10322 )
...
* Add quick link guide to sidebar
* Add QuickStart to TOC
* Update quick links in main page
* Hide some section in More for top nav bar
* Resturct FAQ sections
* Small fix
2024-03-05 14:35:55 +08:00
Xin Qiu
58208a5883
Update FAQ document. ( #10300 )
...
* Update install_gpu.md
* Update resolve_error.md
* Update README.md
* Update resolve_error.md
* Update README.md
* Update resolve_error.md
2024-03-04 08:35:11 +08:00
Jason Dai
4cb4db618d
Update WebUI quickstart ( #10305 )
2024-03-03 22:18:26 +08:00
Shengsheng Huang
1db20dd1d0
add warmup advice in quickstart ( #10293 )
2024-03-01 17:15:45 +08:00
Xin Qiu
509e206de0
update doc about gemma random and unreadable output. ( #10297 )
...
* Update install_gpu.md
* Update README.md
* Update README.md
2024-03-01 15:41:16 +08:00
Shengsheng Huang
90f2f82638
revise webui quickstart ( #10287 )
2024-03-01 10:04:21 +08:00
Cheen Hau, 俊豪
653cb500ed
Add webUI quickstart ( #10266 )
...
* Add webUI quickstart
* Add GPU driver install
* Move images to readthedocs assets
2024-02-29 10:08:06 +08:00
Shengsheng Huang
b88f447974
fix typo and change wording ( #10254 )
2024-02-27 13:40:51 +08:00
Shengsheng Huang
04a6b0040c
Windows GPU Install Quickstart update ( #10240 )
...
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* fix numbering
* Update install_windows_gpu.md
* Update install_windows_gpu.md
2024-02-27 13:14:39 +08:00
Zhicun
7c236e4c6d
quick start for windows with gpu ( #10221 )
...
* quick start for windows igpu
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* update the demo.py
* Update install_windows_gpu.md
* Update install_windows_gpu.md
* fix image position typo
* Update install_windows_gpu.md
* update pip install command
---------
Co-authored-by: Shengsheng Huang <shannie.huang@gmail.com>
2024-02-26 12:19:36 +08:00
Jason Dai
40584dec6d
Update readme ( #10214 )
2024-02-23 11:42:16 +08:00
Yuwen Hu
94cb16fe40
[LLM] Small updates to Win GPU Install Doc ( #10199 )
...
* Make Offline installer as default for win gpu doc for oneAPI
* Small other fixes
2024-02-21 17:58:40 +08:00
Cheen Hau, 俊豪
6952847f68
GPU install doc - add pip install oneAPI for windows ( #10157 )
...
* Add instructions for pip install oneAPI for windows
* Improve clarity
* Format fix
* Fix
* Fix in runtime configuration
2024-02-19 14:46:08 +08:00
Kai Huang
7400401706
Update gpu pip install oneapi doc ( #10137 )
...
* fix link
* fix
* fix
* minor
2024-02-09 11:27:40 +08:00
Cheen Hau, 俊豪
a7f9a13f6e
Enhance gpu doc with PIP install oneAPI ( #10109 )
...
* Add pip install oneapi instructions
* Fixes
* Add instruction for oneapi2023
* Runtime config
* Fixes
* Remove "Currently, oneAPI installed with .. "
* Add pip package version for oneAPI 2024
* Reviewer comments
* Fix errors
2024-02-07 21:14:15 +08:00
binbin Deng
c1ec3d8921
LLM: update FAQ about too many open files ( #10119 )
2024-02-07 15:02:24 +08:00
Jason Dai
e2233dddef
Update README ( #10111 )
2024-02-06 19:29:07 +08:00
Jason Dai
f440cb4fba
Update Self-Speculative Decoding Readme ( #10102 )
2024-02-06 12:59:17 +08:00
binbin Deng
91cf9d41d0
LLM: add solutions of some frequently asked questions ( #10068 )
2024-02-04 09:28:20 +08:00
binbin Deng
4b92235bdb
LLM: add initial FAQ page ( #10055 )
2024-02-01 09:43:39 +08:00
Yuwen Hu
175027c90f
Small clarification for windows installation guide ( #10002 )
2024-01-25 18:39:11 +08:00
Mingyu Wei
bc9cff51a8
LLM GPU Example Update for Windows Support ( #9902 )
...
* Update README in LLM GPU Examples
* Update reference of Intel GPU
* add cpu_embedding=True in comment
* small fixes
* update GPU/README.md and add explanation for cpu_embedding=True
* address comments
* fix small typos
* add backtick for cpu_embedding=True
* remove extra backtick in the doc
* add period mark
* update readme
2024-01-24 13:42:27 +08:00
Cheen Hau, 俊豪
e403e4a8b7
Add APT install instructions for oneAPI ( #9875 )
...
* Add APT installer
* Include reviewer suggestions
* Add note - ensure matching version of oneAPI and pytorch/ipex
* Fix 'command line installer'
* Fix formatting. Address review comments
* Append ':' to '..by running the following commands'
* Fix formatting
* achieve -> archive
2024-01-17 17:30:30 +08:00
Yuwen Hu
0aef35a965
[LLM] Improve LLM doc regarding windows gpu related info ( #9880 )
...
* Improve runtime configuration for windows
* Add python 310/311 supports for wheel downloading
* Add troubleshooting for windows gpu
* Remove manually import ipex due to auto importer
* Add info regarding cpu_embedding=True on iGPU
* More info for Windows users
* Small updates to API docs
* Python style fix
* Remove tip for loading from saved optimize_model for now
* Updated based on comments
* Update win info for multi-intel gpus selection
* Small fix
* Small fix
2024-01-11 14:37:16 +08:00
