ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
2433 commits 1 branch 0 tags 37 MiB
Commit graph

571 commits

Author SHA1 Message Date
Yuwen Hu
a5c9dfdf91 [LLM] Main readme gpu installation related updates (#9868) 
* Main readme gpu installation related updates

* Small updates for readthedocs main page
 2024-01-29 16:33:27 +08:00
binbin Deng
171fb2d185 LLM: reorganize GPU finetuning examples (#9952) 2024-01-25 19:02:38 +08:00
Yuwen Hu
175027c90f Small clarification for windows installation guide (#10002) 2024-01-25 18:39:11 +08:00
Mingyu Wei
bc9cff51a8 LLM GPU Example Update for Windows Support (#9902) 
* Update README in LLM GPU Examples

* Update reference of Intel GPU

* add cpu_embedding=True in comment

* small fixes

* update GPU/README.md and add explanation for cpu_embedding=True

* address comments

* fix small typos

* add backtick for cpu_embedding=True

* remove extra backtick in the doc

* add period mark

* update readme
 2024-01-24 13:42:27 +08:00
Cheen Hau, 俊豪
e403e4a8b7 Add APT install instructions for oneAPI (#9875) 
* Add APT installer

* Include reviewer suggestions

* Add note - ensure matching version of oneAPI and pytorch/ipex

* Fix 'command line installer'

* Fix formatting. Address review comments

* Append ':' to '..by running the following commands'

* Fix formatting

* achieve -> archive
 2024-01-17 17:30:30 +08:00
Yuwen Hu
0aef35a965 [LLM] Improve LLM doc regarding windows gpu related info (#9880) 
* Improve runtime configuration for windows

* Add python 310/311 supports for wheel downloading

* Add troubleshooting for windows gpu

* Remove manually import ipex due to auto importer

* Add info regarding cpu_embedding=True on iGPU

* More info for Windows users

* Small updates to API docs

* Python style fix

* Remove tip for loading from saved optimize_model for now

* Updated based on comments

* Update win info for multi-intel gpus selection

* Small fix

* Small fix
 2024-01-11 14:37:16 +08:00
Kai Huang
5e766e8105 Fix Mixtral typo (#9882) 2024-01-10 19:51:24 +08:00
Kai Huang
b53a5cb6c9 Fix Mixtral typo (#9881) 
* fix typo

* fix doc page
 2024-01-10 19:40:52 +08:00
Yuwen Hu
200fc6a1ee [LLM] Fix llm api doc rendering failure due to ipex auto importer (#9877) 2024-01-10 14:53:25 +08:00
Cheen Hau, 俊豪
b2aa267f50 Enhance LLM GPU installation document (#9828) 
* Improve gpu install doc

* Add troubleshooting - setvars.sh not done properly.

* Further improvements

* 2024.x.x -> 2024.0

* Fixes

* Fix Install BigDL-LLM From Wheel : bigdl-llm[xpu_2.0]

* Remove "export USE_XETLA=OFF" for Max GPU
 2024-01-09 16:30:50 +08:00
Jason Dai
a3725b0816 Update readme (#9865) 2024-01-09 15:19:42 +08:00
Yuwen Hu
5ba1dc38d4 [LLM] Change default Linux GPU install option to PyTorch 2.1 (#9858) 
* Update default xpu to ipex 2.1

* Update related install ut support correspondingly

* Add arc ut tests for both ipex 2.0 and 2.1

* Small fix

* Diable ipex 2.1 test for now as oneapi 2024.0 has not beed installed on the test machine

* Update document for default PyTorch 2.1

* Small fix

* Small fix

* Small doc fixes

* Small fixes
 2024-01-08 17:16:17 +08:00
Kai Huang
62a3c0fc16 Fix quick build doc (#9853) 2024-01-08 14:26:34 +08:00
Yishuo Wang
5c6543e070 Reorganize LLM GPU installation document (#9777) 2024-01-03 13:53:05 +08:00
Jason Dai
3ab3105bab Update readme (#9816) 2024-01-03 12:07:00 +08:00
Jason Dai
361781bcd0 Update readme (#9788) 2023-12-26 19:46:11 +08:00
Xin Qiu
95c03765cb Update install_gpu.md, remove kernel 5.19 requirement. (#9757) 
* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Small fixes

---------

Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
 2023-12-22 16:17:56 +08:00
Yuwen Hu
c00a9144c4 [LLM] Small fixes to llm gpu installation guide (#9700) 2023-12-15 23:13:33 +08:00
Jason Dai
37f509bb95 Update readme (#9692) 2023-12-14 19:50:21 +08:00
Yuwen Hu
68d0c255fc [LLM] Update GPU installation doc (#9693) 
* Temp

* Add win 2.1 doc supports

* Reorg layout

* Fix based on comments

* Small fix
 2023-12-14 18:32:51 +08:00
Yining Wang
a04a027b4c Edit gpu doc (#9583) 
* harness: run llama2-7b

* harness: run llama2-7b

* harness: run llama2-7b

* harness: run llama2-7b

* edit-gpu-doc

* fix some format problem

* fix spelling problems

* fix evaluation yml

* delete redundant space

* fix some problems

* address comments

* change link
 2023-12-11 14:59:07 +08:00
Jason Dai
84a19705a6 Update readme (#9617) 2023-12-09 19:23:14 +08:00
Kai Huang
f7e596d85a Update doc (#9580) 
* update aiohttp in docs

* update doc
 2023-12-01 15:40:37 +08:00
Jason Dai
bda404fc8f Update readme (#9575) 2023-11-30 22:45:52 +08:00
Xin Qiu
32b37f3af7 Update gpu install.md (#9541) 
* Update install_gpu.md

* Update install_gpu.md
 2023-11-28 11:15:03 +08:00
Xin Qiu
0f9a440b06 doc for Multi gpu selection (#9414) 2023-11-20 09:25:58 +08:00
Shaojun Liu
8c603014ac update 2.5.0-snapshot readthedoc (#9440) 2023-11-13 16:31:43 +08:00
Jason Dai
11a05641a4 Update readme (#9348) 2023-11-03 11:27:07 +08:00
binbin Deng
db37edae8a LLM: update langchain api document page (#9222) 2023-10-24 10:13:41 +08:00
Jason Dai
26850ebd36 Update readme (#9237) 2023-10-20 16:13:25 +08:00
binbin Deng
7e96d3e79a LLM: improve gpu supports key feature doc page (#9212) 2023-10-19 18:40:48 +08:00
binbin Deng
efcda3892f LLM: add save & load usage in PyTorch API key feature page (#9183) 2023-10-17 17:24:51 +08:00
binbin Deng
330e67e2c0 LLM: update example doc page (#9186) 2023-10-17 16:26:11 +08:00
binbin Deng
eb3fb18eb4 LLM: improve PyTorch API doc (#9128) 2023-10-11 15:03:39 +08:00
binbin Deng
e4d1457a70 LLM: improve transformers style API doc (#9113) 2023-10-10 09:31:00 +08:00
Jason Dai
7506100bd5 Update readme (#9084) 2023-10-05 16:54:09 +08:00
binbin Deng
760183bac6 LLM: update key feature and installation page of document (#9068) 2023-09-27 15:44:34 +08:00
Jason Dai
51518e029d Update llm readme (#9005) 2023-09-19 20:01:33 +08:00
Yuwen Hu
cb534ed5c4 [LLM] Add Arc demo gif to readme and readthedocs (#8958) 
* Add arc demo in main readme

* Small style fix

* Realize using table

* Update based on comments

* Small update

* Try to solve with height problem

* Small fix

* Update demo for inner llm readme

* Update demo video for readthedocs

* Small fix

* Update based on comments
 2023-09-13 09:23:52 +08:00
Jason Dai
448a9e813a Update Readme (#8959) 2023-09-12 17:27:26 +08:00
Yuwen Hu
3d1c7e7082 Small link fix (#8910) 2023-09-07 13:35:29 +08:00
SONG Ge
7a71ced78f [LLM Docs] Remain API Docs Issues Solution (#8780) 
* langchain readthedocs update

* solve langchain.llms.transformersllm issues

* langchain.embeddings.transformersembeddings/transfortmersllms issues

* update docs for get_num_tokens

* add low_bit api doc

* add optimizer model api doc

* update rst index

* fix coomments style

* update docs following the comments

* update api doc
 2023-09-06 16:29:34 +08:00
Yuwen Hu
cf6a620bae [LLM] BigDL-LLM Documentation Initial Version (#8833) 
* Change order of LLM in header

* Some updates to footer

* Add BigDL-LLM index page and basic file structure

* Update index page for key features

* Add initial content for BigDL-LLM in 5 mins

* Improvement to footnote

* Add initial contents based on current contents we have

* Add initial quick links

* Small fix

* Rename file

* Hide cli section for now and change model supports to examples

* Hugging Face format -> Hugging Face transformers format

* Add placeholder for GPU supports

* Add GPU related content structure

* Add cpu/gpu installation initial contents

* Add initial contents for GPU supports

* Add image link to LLM index page

* Hide tips and known issues for now

* Small fix

* Update based on comments

* Small fix

* Add notes for Python 3.9

* Add placehoder optimize model & reveal CLI; small revision

* examples add gpu part

* Hide CLI part again for first version of merging

* add keyfeatures-optimize_model part (#1)

* change gif link to the ones hosted on github

* Small fix

---------

Co-authored-by: plusbang <binbin1.deng@intel.com>
Co-authored-by: binbin Deng <108676127+plusbang@users.noreply.github.com>
 2023-09-06 15:38:45 +08:00
Jiao Wang
14b95ebfb4 Update Databricks documentation for Pytorch Estimator issue (#8869) 
* update doc

* add image

* update
 2023-09-05 12:59:47 -07:00
Jason Dai
5e58f698cd Update readthedocs (#8882) 2023-09-04 15:42:16 +08:00
Jason Dai
9760eec6de Update readme (#8881) 2023-09-03 12:30:26 +08:00
Jiao Wang
5d90ca2dac Update MPI Estimator to support Pytorch IPEX training (#8303) 
* update

* update

* update

* update

* update

* update with comments

* update

* update

* style

* style

* add doc

* style

* style
 2023-08-28 11:03:29 -07:00
Jason Dai
dcadd09154 Update llm document (#8784) 2023-08-21 22:34:44 +08:00
SONG Ge
f4164e4492 [BigDL LLM] Update readme for unifying transformers API (#8737) 
* update readme doc

* fix readthedocs error

* update comment

* update exception error info

* invalidInputError instead

* fix readme typo error and remove import error

* fix more typo
 2023-08-16 14:22:32 +08:00
Kai Huang
4573ff7ffe Update llm api doc (#8712) 
* change to bigdlllm

* update
 2023-08-10 12:17:19 +08:00
Kai Huang
1b65288bdb Add api doc for LLM (#8605) 
* api doc initial

* update desc
 2023-08-08 18:17:16 +08:00
Yuwen Hu
06ed70fa43 Update google site verification for readthedocs (#8689) 2023-08-04 16:05:28 +08:00
Yuwen Hu
418cb06850 Renew google site verification for readthedocs (#8687) 2023-08-04 15:36:17 +08:00
Khazretgali Sapenov
323b9fd6df Update spark-dataframe.md (#8458) 
Fixed mistype
 2023-07-05 07:46:10 +08:00
binbin Deng
983ea9b1f3 Chronos: fix installation error of prophet (#8426) 2023-07-03 13:34:16 +08:00
Heyang Sun
5ad5ac5356 LightGBM Spark Readthedocs (#8381) 
* LightGBM Spark Readthedocs

* Update secure_lightgbm_on_spark.md

* Update secure_lightgbm_on_spark.md

* Update secure_lightgbm_on_spark.md

* refine

* Update secure_lightgbm_on_spark.md

* add html link

* Update secure_lightgbm_on_spark.md

* Update secure_lightgbm_on_spark.md

* add in yaml
 2023-06-26 13:14:40 +08:00
binbin Deng
99d396c9af Chronos: update tensorflow support in installation doc (#8341) 2023-06-20 10:18:09 +08:00
ZehuaCao
bc11a2b1cd Update distributed-tuning.md (#8324) 2023-06-15 11:29:37 +08:00
Yishuo Wang
fa0b0a4555 [nano] fix optuna version (#8237) 2023-05-31 13:44:04 +08:00
binbin Deng
21d5108f95 Chronos: improve prvd and nb tests with more python versions (#8048) 2023-05-10 13:52:54 +08:00
Ruonan Wang
c0967bc143 [Nano] Fix link of win.md (#8174) 2023-05-09 10:13:19 +08:00
Pingchuan Ma (Henry)
30367f5eb1 [Nano] Add how-to-guide for pytorch async pipeline (#8146) 
* add how-to-guide for pytorch async pipeline

* revise introduction

* resolve image issues
 2023-05-06 22:15:42 +08:00
Ruonan Wang
e178692c2c [Nano] Support python 3.10 in nightly test (#8163) 
* support 3.10

* fix version of onnxruntime-extensions

* upgrade ray

* fix from collections.abc import Iterable

* upgrade onnxruntime-extensions to 0.7.0
 2023-05-06 15:56:40 +08:00
Ruonan Wang
203753270d [Nano] Upgrade python to 3.8 (#8137) 
* upgrade python to 3.8

* fix version of protobuf

* upgrade python in nightly and regression
 2023-05-05 13:11:32 +08:00
Le-Zheng
9fdbede632 update 2.4.0-snapshot readthedoc (#8127) 2023-04-24 15:47:41 +08:00
binbin Deng
5ed3ac52c0 Chronos: update information about python version in installation document (#8081) 2023-04-24 11:17:35 +08:00
Cengguang Zhang
5ebfaa9a77 Doc: Add known issues for Orca. (#8096) 
* Doc: add known issues for orca.

* fix: fix style.

* fix: style.
 2023-04-21 14:48:33 +08:00
Yuwen Hu
9ffd1f6dda Mock prophet as doc building failed (#8083) 2023-04-19 17:24:58 +08:00
Pingchuan Ma (Henry)
c6eccbfcc2 [Nano] add pt dgpu inference how-to-guide (#8026) 
* docs for arc dgpu how-to-guide

* minor adjustment + system info

* minor adjustment for appearance

* fix bugs

* add system info

* fix syntax errors

* adjust docs according to comments

* final adjustment

* delete gpu workflow testing
 2023-04-12 19:18:16 +08:00
Junwei Deng
2daaa6f7de Nano: TF multi process how-to for customized training loop (#8006) 
* add how-to guide

* add overview

* fix doc

* fix pep8

* update the notebook
 2023-04-07 17:19:47 +08:00
joan726
9695ef2978 Updated Powered By and Blogs (#7909) 
* Update blogs.md

* Update powered-by.md

* Update powered-by.md

Corrected Yahoo! to Yahoo! JAPAN
 2023-04-07 15:02:03 +08:00
Junwei Deng
a6f96521af Chronos: AIOps User Guide (#7960) 
* add aiops doc

* add image

* fix typo
 2023-03-31 10:15:00 +08:00
Jiao Wang
a02402e410 update (#7904) 2023-03-20 01:38:53 -07:00
Jason Dai
eac9b088e2 [Document] Update Nano description (#7872) 2023-03-15 08:36:19 +08:00
Xiangyu Tian
144efd0748 Add MAA part to azure_ppml readthedocs document (#7857) 
Docs modification to add how to enable MAA in azure_ppml.
 2023-03-14 14:45:58 +08:00
Xin Qiu
633668c882 Update nnframes.md (#7808) 2023-03-08 15:29:00 +08:00
Xin Qiu
a1a1f914bb Fix dllib nnframes doc (#7806) 
* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md
 2023-03-08 15:13:27 +08:00
Yuwen Hu
e5e5c06863 Mock sigfig for doc build to fix the failed rendered API doc (#7800) 2023-03-08 10:00:23 +08:00
SONG Ge
17474d9402 databricks guide update (#7747) 2023-03-02 17:06:27 +08:00
Yuwen Hu
67a343762e Add inherited-members for TF InferenceOptimizer to make sure the methods from BaseInferenceOptimizer shown in API doc (#7735) 2023-03-02 10:08:07 +08:00
SONG Ge
f2950e55a2 add notes for python version issue in databricks tutorial (#7730) 2023-03-02 09:38:58 +08:00
Kai Huang
732f122711 Minor update on k8s tutorial (#7718) 2023-03-01 10:56:07 +08:00
Junwei Deng
528717da46 Chronos: bigdl.chronos.aiops first push (#7703) 
* add bigdl.chronos.aiops

* update doc

* update doc

* update the aiops doc

* update doc

* add test script
 2023-02-28 16:58:25 +08:00
SONG Ge
a1ee2f8b68 [ORCA] K8s Tutorial Update (#7710) 
* fix k8s tutorial style

* update command
 2023-02-28 16:53:33 +08:00
Yuwen Hu
6d174f8012 [Nano/Chronos] Restyle installation panel (#7686) 
* Fix to nano installation panel styles to avoid swing behaviour

* Generalize the installation panel css for chronos and nano, and make some improvements
 2023-02-24 17:21:24 +08:00
Kai Huang
51b8ff3728 Update k8s doc - remove env from yaml (#7670) 2023-02-23 18:29:22 +08:00
Yishuo Wang
48f5144a34 Nano: remove inc from [inference] option on windows (#7664) 2023-02-23 16:30:08 +08:00
Kai Huang
ce8f11c240 Update K8s doc (#7666) 
* update doc

* update yaml
 2023-02-23 16:15:06 +08:00
Kai Huang
f997cc5d60 Update k8s yaml (#7625) 
* remove integrate

* update yaml

* rename

* update

* fix path

* update

* remove local

* remove archive

* update commands

* update spark/bigdl home

* fix

* align order

* update cluster

* remove resources
 2023-02-23 09:49:12 +08:00
Yuwen Hu
d4c46a011c [Nano] Update installation panel to include stock TensorFlow (#7622) 
* Update installation panel for Nano to include stock TensorFlow

* Update nano installation table styles

* Fix selector which is too wide, and other small fixes
 2023-02-22 17:55:03 +08:00
binbin Deng
33306da4d4 Chronos: update how to download from dockerhub in guide (#7637) 2023-02-22 16:51:34 +08:00
Qiyuan Gong
aea71ce4d7 [PPML] Refine Occlum Ali ECS Development Guide Doc Style (#7602) 
* Fix Occlum arch link
* Fix style
* Refine words
 2023-02-21 13:35:39 +08:00
binbin Deng
2bc6e03635 Chronos: update dockerfile (#7584) 2023-02-20 09:45:51 +08:00
Yang Wang
0e31d15f6d Restructure pytorch inference documentation (#7608) 
Co-authored-by: yang3.wang@intel.com <Yang Wang>
 2023-02-17 14:28:36 -08:00
Kai Huang
d961fdee59 Remove 246/312/313 from script names (#7593) 
* remove 246

* remove 313

* fix pandas version
 2023-02-17 14:44:23 +08:00
Qiyuan Gong
bcfcb3f12b [PPML] Alibaba ECS Occlum CN Develop guide (#7297) 
* Alibaba ECS Occlum CN Develop guide with Occlum
* Refine examples and style based on comments
* Add to readthedocs
 2023-02-17 14:06:41 +08:00
binbin Deng
8a8fe7ff9f Chronos: upgrade torch to 1.13.1 and add description about onnx in troubleshooting page (#7523) 2023-02-17 09:27:00 +08:00
SONG Ge
73f6d79e8c [Orca] Known Issues Update (#7569) 
* add known issue for no space left

* update style

* update with comments

* new update
 2023-02-16 15:24:08 +08:00
Kai Huang
29e52af49b Update yarn doc (#7566) 2023-02-16 09:44:33 +08:00
Yinchen Ni
479042a93a Doc: add yarn cluster running results (#7562) 
* feat(yarn.md): add yarn cluster run results

* fix(yarn.md): rm extra |

* docs(yarn.md): perf description

* docs(yarn.md): perf

* feat(yarn.md): how to see logs

* fix(yarn.md): perf: time

* perf(yarn.md): rm which python

* fix(yarn.md): hide internal info

* docs(yarn.md): perf

* fix(yarn.md): url
 2023-02-15 20:02:06 +08:00