Commit graph

631 commits

Author SHA1 Message Date
binbin Deng
5ed3ac52c0 Chronos: update information about python version in installation document (#8081) 2023-04-24 11:17:35 +08:00
Cengguang Zhang
5ebfaa9a77 Doc: Add known issues for Orca. (#8096)
* Doc: add known issues for orca.

* fix: fix style.

* fix: style.
2023-04-21 14:48:33 +08:00
Pingchuan Ma (Henry)
c6eccbfcc2 [Nano] add pt dgpu inference how-to-guide (#8026)
* docs for arc dgpu how-to-guide

* minor adjustment + system info

* minor adjustment for appearance

* fix bugs

* add system info

* fix syntax errors

* adjust docs according to comments

* final adjustment

* delete gpu workflow testing
2023-04-12 19:18:16 +08:00
Junwei Deng
2daaa6f7de Nano: TF multi process how-to for customized training loop (#8006)
* add how-to guide

* add overview

* fix doc

* fix pep8

* update the notebook
2023-04-07 17:19:47 +08:00
joan726
9695ef2978 Updated Powered By and Blogs (#7909)
* Update blogs.md

* Update powered-by.md

* Update powered-by.md

Corrected Yahoo! to Yahoo! JAPAN
2023-04-07 15:02:03 +08:00
Junwei Deng
a6f96521af Chronos: AIOps User Guide (#7960)
* add aiops doc

* add image

* fix typo
2023-03-31 10:15:00 +08:00
Jiao Wang
a02402e410 update (#7904) 2023-03-20 01:38:53 -07:00
Jason Dai
eac9b088e2 [Document] Update Nano description (#7872) 2023-03-15 08:36:19 +08:00
Xiangyu Tian
144efd0748 Add MAA part to azure_ppml readthedocs document (#7857)
Docs modification to add how to enable MAA in azure_ppml.
2023-03-14 14:45:58 +08:00
Xin Qiu
633668c882 Update nnframes.md (#7808) 2023-03-08 15:29:00 +08:00
Xin Qiu
a1a1f914bb Fix dllib nnframes doc (#7806)
* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md
2023-03-08 15:13:27 +08:00
SONG Ge
17474d9402 databricks guide update (#7747) 2023-03-02 17:06:27 +08:00
Yuwen Hu
67a343762e Add inherited-members for TF InferenceOptimizer to make sure the methods from BaseInferenceOptimizer shown in API doc (#7735) 2023-03-02 10:08:07 +08:00
SONG Ge
f2950e55a2 add notes for python version issue in databricks tutorial (#7730) 2023-03-02 09:38:58 +08:00
Kai Huang
732f122711 Minor update on k8s tutorial (#7718) 2023-03-01 10:56:07 +08:00
Junwei Deng
528717da46 Chronos: bigdl.chronos.aiops first push (#7703)
* add bigdl.chronos.aiops

* update doc

* update doc

* update the aiops doc

* update doc

* add test script
2023-02-28 16:58:25 +08:00
SONG Ge
a1ee2f8b68 [ORCA] K8s Tutorial Update (#7710)
* fix k8s tutorial style

* update command
2023-02-28 16:53:33 +08:00
Yuwen Hu
6d174f8012 [Nano/Chronos] Restyle installation panel (#7686)
* Fix to nano installation panel styles to avoid swing behaviour

* Generalize the installation panel css for chronos and nano, and make some improvements
2023-02-24 17:21:24 +08:00
Kai Huang
51b8ff3728 Update k8s doc - remove env from yaml (#7670) 2023-02-23 18:29:22 +08:00
Yishuo Wang
48f5144a34 Nano: remove inc from [inference] option on windows (#7664) 2023-02-23 16:30:08 +08:00
Kai Huang
ce8f11c240 Update K8s doc (#7666)
* update doc

* update yaml
2023-02-23 16:15:06 +08:00
Kai Huang
f997cc5d60 Update k8s yaml (#7625)
* remove integrate

* update yaml

* rename

* update

* fix path

* update

* remove local

* remove archive

* update commands

* update spark/bigdl home

* fix

* align order

* update cluster

* remove resources
2023-02-23 09:49:12 +08:00
Yuwen Hu
d4c46a011c [Nano] Update installation panel to include stock TensorFlow (#7622)
* Update installation panel for Nano to include stock TensorFlow

* Update nano installation table styles

* Fix selector which is too wide, and other small fixes
2023-02-22 17:55:03 +08:00
binbin Deng
33306da4d4 Chronos: update how to download from dockerhub in guide (#7637) 2023-02-22 16:51:34 +08:00
Qiyuan Gong
aea71ce4d7 [PPML] Refine Occlum Ali ECS Development Guide Doc Style (#7602)
* Fix Occlum arch link
* Fix style
* Refine words
2023-02-21 13:35:39 +08:00
binbin Deng
2bc6e03635 Chronos: update dockerfile (#7584) 2023-02-20 09:45:51 +08:00
Yang Wang
0e31d15f6d Restructure pytorch inference documentation (#7608)
Co-authored-by: yang3.wang@intel.com <Yang Wang>
2023-02-17 14:28:36 -08:00
Kai Huang
d961fdee59 Remove 246/312/313 from script names (#7593)
* remove 246

* remove 313

* fix pandas version
2023-02-17 14:44:23 +08:00
Qiyuan Gong
bcfcb3f12b [PPML] Alibaba ECS Occlum CN Develop guide (#7297)
* Alibaba ECS Occlum CN Develop guide with Occlum
* Refine examples and style based on comments
* Add to readthedocs
2023-02-17 14:06:41 +08:00
binbin Deng
8a8fe7ff9f Chronos: upgrade torch to 1.13.1 and add description about onnx in troubleshooting page (#7523) 2023-02-17 09:27:00 +08:00
SONG Ge
73f6d79e8c [Orca] Known Issues Update (#7569)
* add known issue for no space left

* update style

* update with comments

* new update
2023-02-16 15:24:08 +08:00
Kai Huang
29e52af49b Update yarn doc (#7566) 2023-02-16 09:44:33 +08:00
Yinchen Ni
479042a93a Doc: add yarn cluster running results (#7562)
* feat(yarn.md): add yarn cluster run results

* fix(yarn.md): rm extra |

* docs(yarn.md): perf description

* docs(yarn.md): perf

* feat(yarn.md): how to see logs

* fix(yarn.md): perf: time

* perf(yarn.md): rm which python

* fix(yarn.md): hide internal info

* docs(yarn.md): perf

* fix(yarn.md): url
2023-02-15 20:02:06 +08:00
Kai Huang
213cfd985b Update k8s tutorial (#7563) 2023-02-15 19:26:25 +08:00
Kai Huang
2e1d977e08 Update k8s command (#7532)
* remove redundant conf

* update command

* update command

* format

* change to num executor

* fix

* minor

* fix

* modify cores

* remove pythonhome

* meet review

* minor

* rephase

* minor

* minor

* update yarn master

* update args
2023-02-15 19:09:27 +08:00
Cengguang Zhang
7727b4c9ba feat: update download link (#7559) 2023-02-15 17:58:02 +08:00
Yishuo Wang
13568a9aa8 Nano: fix multi-instance on Windows (#7493) 2023-02-10 18:05:18 +08:00
Yuwen Hu
6960c87b54 [Nano] Revise outdated info in PyTorch Inference how-to guides (#7453)
* Change order of PyTorch Inference how-to guides order

* Revise accelerate_pytorch_inference_jit_ipex.ipynb

* Revise accelerat_pytorch_inference_onnx.ipynb

* Revise accelerate_pytorch_inference_openvino.ipynb

* Revise inference_optimizer_optimize.ipynb

* Revise multi_instance_pytorch_inference.ipynb

* Revise pytorch_context_manager.ipynb

* Revise pytorch_save_and_load_ipex.ipynb and other small fixes

* Revise pytorch_save_and_load_jit.ipynb and other small fixes

* Revise pytorch_save_and_load_onnx.ipynb and other small fixese

* Revise pytorch_save_and_load_openvino.ipynb

* Revise quantize_pytorch_inference_inc.ipynb and other small fixes

* Revise quantize_pytorch_inference_pot.ipynb and other small fixes

* Fix failed links in the index page

* Small fixes

* Update based on comments
2023-02-09 17:50:50 +08:00
Yishuo Wang
56d699d935 Nano: update os support (#7491) 2023-02-09 15:48:30 +08:00
Yuwen Hu
9c129ec158 [Nano] Revise PyTorch Inference key feature doc regarding context manager (#7449)
* Revise PyTorch Inference key feature doc regarding context manager

* Small fixes and revise the installation notes

* Small fix

* Update based on comments

* Update based on comments
2023-02-08 17:26:08 +08:00
Yishuo Wang
f4700422e1 Nano: add OS support table (#7429) 2023-02-06 18:01:31 +08:00
Kai Huang
8911c69302 Update k8s tutorial and script (#7356)
* debug

* update train

* update remote dir

* remove print

* update train

* update
2023-02-06 11:24:07 +08:00
Ruonan Wang
06e6935ba9 Nano: update troubleshooting guide (#7285)
* update troubshooting guide

* update based on comment
2023-02-03 17:29:58 +08:00
Yang Wang
f903b78711 restructure tensorflow inference document (#7417) 2023-02-02 18:14:02 -08:00
Yuwen Hu
c31136df0b [Nano] Improve How-to Guides Navigations (#7396)
* Remove deprecated option enable_auto_doc_ref for recommonmark

* Add first level navigation structure for Nano how-to guides

* Update navigation for How-to Training part

* Update navigation for How-to Inference part

* Update navigation for How-to Preprocessing/Install part and other small fixes

* Fix wrong link path caused by position changes of how-to install related guides

* Small fix
2023-02-03 09:37:10 +08:00
binbin Deng
c74320db0e Chronos: update installation panel (#7393) 2023-02-02 13:16:23 +08:00
Yuwen Hu
c7674f52b2 [Nano] Add how-to guide for TensorFlow Keras inference using bf16 mixed precision (#7337)
* Add basic structure for tf bf16 infer how-to guide

* Add how-to use BFloat16 mixed precision for TensorFlow Keras inference

* Small fixes

* Add instruction requires box

* Add outputs to show inference time diff

* Small fixes regarding hardware requirements and others

* Update based on comments

* Small fixes

* Small fixes
2023-02-01 13:33:54 +08:00
Junwei Deng
08a556239c Chronos: add how to guide for forecaster.optimize (#7387) 2023-02-01 11:39:27 +08:00
Junwei Deng
90c76ce7a2 Nano: Add some user guide and warning messages according to feedback (#7374) 2023-02-01 08:53:08 +08:00
Kai Huang
4568403d47 Enhance k8s tutorial (#7366)
* add driver log

* update

* minor
2023-01-29 17:45:55 +08:00
Kai Huang
61f25b1a6c Fix k8s tutorial style (#7363) 2023-01-29 16:32:08 +08:00
Kai Huang
6c07f95d1c Update Howto guides (#7361)
* update ray

* update tf
2023-01-29 15:12:27 +08:00
Kai Huang
6a4c40fc1f Update PyTorch quickstart (#7358)
* update pytorch

* minor

* minor
2023-01-29 13:39:06 +08:00
Cengguang Zhang
eeebdc3f5b Doc: Centering style in download table. (#7338)
* feat: centering style.

* feat: centering style.

* feat: centering.
2023-01-19 18:35:59 +08:00
Cengguang Zhang
3815595940 feat: update download link. (#7331) 2023-01-19 14:48:06 +08:00
Le-Zheng
1ae23bf068 update release doc main (#7329) 2023-01-19 13:13:34 +08:00
Kai Huang
73ceb1ca92 Update gzip command in FashionMNIST tutorial (#7298) 2023-01-17 16:54:38 +08:00
Kai Huang
8e4e643f53 Update k8s tutorial (#7278)
* part1

* update gzip

* update
2023-01-17 09:52:14 +08:00
Sirui Tao
3543a58723 [Nano] How-to Guide: Inference via Openvino on Intel GPUs (#7212)
* add openvino gpu inference guide

* enable online doc for how-to

* fix

* fix layout error

* update w.r.t. comments

* fix

* fix

* fix error
2023-01-12 09:31:12 +08:00
Hamster
cc6f9b4dd2 docs(orca-context.md): RayContext -> OrcaRayContext (#7227) 2023-01-11 19:28:19 +08:00
Yuwen Hu
06cb1971c7 [Nano] Fix import path in API docs (#7208)
* Small fixes to (un)patch_tensorflow api doc and make its import path in api doc show as the recommended one

* Add api doc for nano_bf16 decorator

* Move api doc for bigdl.nano.tf.keras.InferenceOptimizer out of bigdl.nano.tf.keras to make it more clear

* Fix python styles

* Fix path in Nano PyTorch API docs

* Add api doc for bigdl.nano.pytorch.patching.patch_encryption

* Add a note box for bigdl.nano.pytorch.patching.patch_encryption api doc

* Fix Python style again

* Fix path in Nano HPO API doc and other small fixes
2023-01-11 14:24:12 +08:00
liangs6212
5ebaa3a41b Nano: Updated the description of “python version” (#7220)
* update versions

* rename
2023-01-11 10:10:55 +08:00
Henry Ma
2858a1b5bf [Nano] Add how-to-guide of load/save API for tensorflow inference (#7180)
* feat(docs): add load/save onnx and opnevino model for tensorflow

* fix bugs after previewing

* fix order issues of insertion for toc.yml

* change link title for tensorflow
2023-01-10 20:15:49 +08:00
Sirui Tao
d950992b91 [Nano] How-To Guides: Accelerate PyTorch Training with IPEX & Multi-instance & BF16 & Channels last (#7035)
* add pytorch training ipex guide

* add pytorch training multi-instance guide

* add bf16 guide

* small changes of presentation

* add channels last guide

* remove validation loader

* hide code block

* update based on comments

* add guide for reference

* update guides w.r.t. comments
2023-01-10 13:14:47 +08:00
Kai Huang
af9cdc6edd Update spark-submit section in yarn tutorial (#7209)
* update

* update
2023-01-10 09:55:30 +08:00
Yishuo Wang
c4874f35c8 Nano: Add key feature for keras inference (#6925) 2023-01-09 16:43:15 +08:00
Kai Huang
19f00e80dc Update download document (#7202)
* update download

* minor

* update
2023-01-09 15:27:27 +08:00
Hu, Zhaojie
6ca8f8567f Chronos: Add how to guide for export_jit (#7194)
* add how to guide for export_jit

* update

* update

* update code example
2023-01-09 14:05:49 +08:00
YingzhePeng
ac78c2f532 Orca download url modify (#7198)
* change the download url

* change the download url version
2023-01-09 10:59:48 +08:00
liangs6212
9db2b48519 Chronos: How to use built-in dataset (#6572)
* add how to use built-in dataset

* how-to-use-built-in-dataset

* fix issue

* rst link

* remove dedundancy code

* fix syntax error

* fix conflict

* reset

* reset again
2023-01-05 19:22:21 +08:00
Junwei Deng
1d4d65dd07 Nano: add Neural Coder example and document (#7167)
* add NC example on nano

* update information
2023-01-05 18:13:44 +08:00
Yuwen Hu
5e9ef7b553 [Nano] Add a generalized how-to guide for accelerate PyTorch cv data process pipeline (#7125)
* Restyle blockquote elements in web

* Add a generalized how-to section for preprocessing, including the data process accelerastion for PyTorch

* Small fix

* Update based on comments and small typo fixes

* Small fixes
2023-01-05 18:07:10 +08:00
Yuwen Hu
bfca337d09 [Nano] Add how-to guide for TensorFlow Keras training using bf16 (#7169)
* Add basic doc structure for bf16 tf training how-to guide, and change the incorrect order of tf inference guides in toc

* Add how-to guide for tf bf16 training

* Add warning box for tf bf16 hardware limitations

* Add a print message to show the default policy of model after unpatch

* Small fixes

* Small github action fixes for tf bf16 training how-to guide

* diable action test for tf bf16 train for now, due to the core dumped problem on platforms without AVX512

* Updated based on comments
2023-01-05 17:59:43 +08:00
YingzhePeng
3fd27f51a8 Automerge for updating the url. (#7164)
* update

* add automeger yaml file.

* update

* change the job name
2023-01-05 11:55:21 +08:00
Henry Ma
18ae409b7c [Nano] add how-to-guide for tensorflow inference by onnxruntime and openvino (#7149)
* Feat(docs): add how-to-guide for tensorflow inference by onnxruntime and openvino

* fix bugs for index.rst

* revise according to PR comments

* revise minor parts according to PR comments

* revise bugs  according to PR comments
2023-01-04 23:43:48 +08:00
Yishuo Wang
ab9a3b69fb Nano: Add CUDA patch key feature (#7089) 2023-01-04 10:53:27 +08:00
Junwei Deng
56e94eda59 Chronos: add forecaster alg choose guide and some cleaning for how to guide (#7139)
* fix format

* fix

* update

* update
2023-01-03 15:00:27 +08:00
Ruonan Wang
925874b2cd Nano: improve Howto guide of InferenceOptimizer.optimize (#6924)
* update howto guide for optimizer

* update export model

* update typo

* update based on comments

* fix bug of get_best_model without validation data

* update ut

* update

* update

* fix 600s

* fix
2023-01-03 14:08:05 +08:00
Henry Ma
614d2ab289 Nano: fix some typos of web documentation (#7113) 2023-01-03 10:28:32 +08:00
Kai Huang
189a2f5179 Update Orca How-to index (#7137)
* update index

* fix style

* fix ray

* fix

* update
2022-12-30 17:11:11 +08:00
Kai Huang
264451c6bd Merge Orca quick starts and how to (#7133)
* add tf2 to howto

* update tf2

* remove

* modify sidebar

* remove quickstart

* minor
2022-12-30 16:05:15 +08:00
Yishuo Wang
6375e36f00 Nano: upgrade openvino to 2022.3.0 and torchmetics to 0.11.0 (#7091) 2022-12-29 17:35:37 +08:00
Yuwen Hu
c66cca0c62 [Nano] Add more key features regarding TorchNano and @nano for PyTorch training (#7072)
* Add more key features regarding TorchNano and @nano for pytorch training

* Small fixes

* Remove the Overview title

* Add auto_lr in related notes

* Update based on comments
2022-12-27 16:52:49 +08:00
liangs6212
da7b30529b Nano: Update the Nano installation panel (#7015)
* update installation panel

* fix typo

* fix typo again

* fix typo

* experimental change

* fix typo

* fix known issues

* update

* update subsections

* update typo

* update according to comment

Co-authored-by: TheaperDeng <theaperdeng@outlook.com>
2022-12-26 15:43:36 +08:00
Yuwen Hu
37b0c6fa50 [Nano] How-To Guides: Convert to TorchNano & use @nano decorator (#5984)
* Add how to guide: How to convert your PyTorch code to use TorchNano for training acceleration

* Small nano how-to index format update for openvino inference

* Update based on comments

* Updated based on comments

* Add how-to guide: How to wrap a PyTorch training loop through @nano decorator

* Add reference to TorchNano guide in @nano guide

* Some small fixes and updates

* Small typo fix: bulit -> built

* Updates based on comments

* Remove validation dataloader based on comments

* Order change of two guides

* Update based on comments
2022-12-26 15:36:53 +08:00
Ruonan Wang
14cf4aff72 Nano: Troubshooting guide for BigDL-Nano (#6910)
* add troubshooting guide

* add more cases

* update style

* update

* update style

* update two cases

* update

* add two issue
2022-12-26 10:02:44 +08:00
Yuwen Hu
6bc720d26a [Nano] Add API doc for bigdl.nano.pytorch.nano decorator (#7068)
* Add Api doc for bigdl.nano.pytorch.nano decorator

* Fix Python styles

* Small fix

* Remove strange 'method' in InferenceOptimizer api doc
2022-12-26 09:25:57 +08:00
Ruonan Wang
935fc48354 Nano: update PyTorch inference key feature doc (#6938)
* upddate installation

* update

* update runtime acceleration

* update link in rst

* add bf16 quantization and optimize()

* update based on comment

* update

* update based on comment
2022-12-22 13:34:18 +08:00
Yishuo Wang
3b6c56b505 Nano: update nano known issue (#7063) 2022-12-22 09:53:05 +08:00
Yishuo Wang
0a62df22aa Nano: quick fix typo (#7064) 2022-12-21 16:31:15 +08:00
Junwei Deng
dea7b8f9f2 Nano: update train pytorch key feature doc (#6906)
* update train doc

* update train page
2022-12-19 15:51:19 +08:00
binbin Deng
217e8a1c2b Chronos: update python3.8 support in document (#6951)
* update

* update

* fix

* fix
2022-12-19 15:39:30 +08:00
Junwei Deng
f304d33168 Nano: add patching function for dtype (#6947)
* add patching function for dtype

* update

* fix pep8

* update the parameter name
2022-12-16 16:16:12 +08:00
Kai Huang
6b65968e3c Remove save entire model in doc (#6986) 2022-12-14 17:04:15 +08:00
Yuwen Hu
12487a4c5a Hide ALL_INFERENCE_ACCELERATION_METHOD in api doc rendering for bigdl.nano.tf.keras.InferenceOptimizer (#6973) 2022-12-14 13:01:53 +08:00
Ruonan Wang
b3feb53c4a Nano: add key feature and how to guide for context manager (#6897)
* add key feature and how to guide for context manager

* update key feature for multi models

* update based on comment

* update

* update based on comments

* update

* update
2022-12-13 16:57:52 +08:00
Cengguang Zhang
de88f1e6b3 doc: add load to pytorch estimator quickstart. (#6920)
* doc: add load to pytorch estimator quickstart.

* fix: fix style.

* fix typo

* fix wording.
2022-12-13 14:31:15 +08:00
Yishuo Wang
664dfbe7ef Nano: Add key feature and how to guide for multi-instance inference (#6901) 2022-12-13 14:18:26 +08:00
Ziyao Peng
99d6decfeb Orca docs: The mv command in the document k8s.md needs to be modified (#6939) 2022-12-13 10:51:43 +08:00
Hu, Zhaojie
9fae00dafd Chronos: Update doc to illustrate deploy mode in TSDataset (#6871)
* update doc to illustrate deploy mode

* fix

* revise howto guide
2022-12-13 09:44:30 +08:00
joan726
414c220111 Update presentations.md and powered-by.md (#6699) 2022-12-12 16:52:33 +08:00
Yishuo Wang
7e180d028e Nano: update tensorflow examples (#6935) 2022-12-12 13:56:05 +08:00
Ziyao Peng
56a2d8f1cd Orca docs: The mv command in the document needs to be modified (#6927)
* Update yarn.md

* Update yarn.md

* Update yarn.md

* Update yarn.md
2022-12-12 09:52:38 +08:00
binbin Deng
eceedbe196 Chronos: update benchmark tool guide to demonstrate new functions (#6882) 2022-12-09 17:34:44 +08:00
Cengguang Zhang
7a8bd4cee5 Doc: copy faq to known issues. (#6915)
* feat: copy faq to known issues.

* fix: add ray issues section.
2022-12-08 16:57:18 +08:00
Yishuo Wang
7e2742cace Nano: Update examples and tutorials (#6888) 2022-12-08 11:23:48 +08:00
Hu, Zhaojie
044785173e Chronos: Update chronos-nightly Dockerfile and notebook (#6899)
* update docker file and notebook

* fix comment

* fix comment
2022-12-08 09:45:55 +08:00
liangs6212
ae7160790d Doc: Nano installation panel (#6852)
* add nano installation panel

* try fix

* try fix again

* fix typo

* add versions

* try fix second

* try fix second again

* fix col width

* rollback

* rollback again

* fix syntax error

* fix syntax error again

* fix syntax error last

* fix syntax

* fix syntax

* fix syntax again

* add some comment

* try fix

* try fix

* try fix again

* try fix

* fix typo

* fix some error

* fix typo

* some optimization

* change width

* change width again

* change width again

* change width again

* last width change

* fix description error

* change inference default to yes

* switch inferenceyes and inferenceno
2022-12-07 14:30:11 +08:00
Cengguang Zhang
b96d39db4a Orca: update yarn tutorial (#6857)
* doc: 1.  update yarn tutorial
2. upload deployment diagram.

* fix: code style.

* fix: remove unnecessary changes.

* fix: code style.

* fix: fix wording.

* fix: fix wording.
2022-12-02 17:09:53 +08:00
Kai Huang
fdcf509681 Update doc style (#6841)
* minor

* trial

* change to dot
2022-12-01 17:54:33 +08:00
Cengguang Zhang
536f84cc34 Doc: add how-to guides to navigation box. (#6842)
* feat: update index.rst.

* fix: fix order.

* fix: delete unecessary line.
2022-12-01 17:36:53 +08:00
Kai Huang
bf96cada20 Update yarn doc (#6840)
* update

* update

* update install

* minor
2022-12-01 16:54:35 +08:00
Junwei Deng
87507ba715 Nano: add partial m-series chip support for tensorflow (training and installation) (#6520)
* add m1 chip support

* fix setup
2022-11-30 13:18:00 +08:00
Jiao Wang
81a9f8147c [PPML] Azure Gramine documentation (#6627)
* update az gramine doc

* add python example

* update

* update

* update
2022-11-29 14:48:57 -08:00
Xiangyu Tian
bd112d6cf3 [PPML] Add Azure Attestation part to Attestation Basic Docs (#6781)
* Init

* Fix

* Refine

* Refine

* Refine
2022-11-28 16:08:36 +08:00
Qiyuan Gong
3571247d65 [PPML] Attestation basic (#6778)
* Add attestation basic doc to readthedoc
2022-11-28 13:26:52 +08:00
WangJun
bf5ccae4ef [Nano] add how to guide save and load jit, ipex, onnx, openvino (#6659)
* add how to guide:
* acclerate with jit_ipex
* save and load jit, ipex, onnx, openvino
* add these five above .nblink files
;

* add index of sl files

* clear all the output & fix the bug of title

* remove extra blank indent

* format the jupter with prettier

* fix the bug of error words

* add blank line before unorder list

* * remove the normal inference in accelerate using jit/ipex;
* add note to example why we should pass in the orginal model to get the optimized one in sl ipex

* fix:new pip install shell cmd  & indent improve
2022-11-25 15:47:15 +08:00
liangs6212
cd04f7dbdc Chronos: Update installation panel for inference option (#6742)
* first commit

* add inference button

* fix typo

* fix typo again

* fix syntax error

* try fix

* rollback

* try fix again

* add comment

* fix installation error

* rename

* try fix

* rollback

* fix error

* fix error again

* try fix
2022-11-25 15:26:35 +08:00
Qiyuan Gong
621168ce2e [PPML] Move dev guide to tutorial (#6765)
* Move dev guide to tutorial & examples.
2022-11-25 15:02:11 +08:00
binbin Deng
df775d172e Chronos: benchmark tool user guide (#6668) 2022-11-25 11:25:34 +08:00
Qiyuan Gong
1b46df7e65 [PPML] Refine readthedoc development guide (#6685)
* Add migrate without code change.
* Add SGX/TDX design guide.
* Refine link & add description.
2022-11-25 08:36:47 +08:00
Cengguang Zhang
ebe75782dd Doc: add download link and script in orca installation. (#6750)
* feat: add download orca in installation.

* fix: fix wording.

* fix: fix typo.

* fix: fix wording.

* fix: fix link and add scripts.

* fix: fix wording.

* fix: fix wording.

* fix: add empty check for env variables.

* fix: fix echo.

* fix: update download link

* fix: fix style.

* fix: fix style.

* fix: fix wording and style.

* fix: fix style.

* fix: fix style.

* fix: fix style.
2022-11-24 16:40:57 +08:00
Yuwen Hu
988bdc18cf Remove DEFAULT_INFERENCE_ACCELERATION_METHODfor InferenceOptimizer.optimize pniapi doc (#6745) 2022-11-24 11:26:52 +08:00
Kai Huang
982d3ac786 Update PyTorch Estimator doc (#6727)
* update doc

* update code doc

* minor

* minor

* fix typo
2022-11-23 19:40:23 +08:00
Cengguang Zhang
745aaef5df Orca: update doc for pytorch estimator backend. (#6723)
* feat: update doc for pytorch estimator backend.

* fix: remove ray global dependency.

* rm: remove .swp file.

* fix: revert ray import fix.

* fix: replace model and optimizer with  model_creator and optimizer_creator.

* fix: delete unnecessary links.

* fix: update index.md

* fix: fix code style of quickstart and jupyter notebook.

* fix: remove criterion.

* fix: fix dataset description.

* fix: fix code style.

* fix: fix code style.

* fix: update batch size and link

* fix: update link

* fix: fix code style.

* fix: fix unnecessary code.

* fix: fix typo.

* fix: use relative path.

* fix: fix typo.

* fix: fix link.
2022-11-23 19:09:01 +08:00
Cengguang Zhang
ca3b088522 Doc: update sidebar and quickstarts order. (#6743)
* doc: update sidebar and quickstarts order.

* fix: adjust quickstart order.

* fix: fix typo.

* fix: fix typo.
2022-11-23 18:57:11 +08:00
Kai Huang
d0388cb8d8 Update K8s tutorial (part4) (#6724)
* update python

* update spark-submit
2022-11-22 19:51:04 +08:00
Cengguang Zhang
7f2beefb7b fix: update pytorch estimator backend. (#6721) 2022-11-22 16:50:33 +08:00
Kai Huang
e249e32c6f Update K8s tutorial (part3) (#6719) 2022-11-22 15:56:23 +08:00
Kai Huang
bb3889958c Update k8s tutorial (part2) (#6700) 2022-11-21 19:57:22 +08:00
Kai Huang
cdd1f8421e Update k8s tutorial (part1) (#6696)
* update 1.1

* update 3

* update 1.2 1.3
2022-11-21 19:01:30 +08:00
Kai Huang
78ee9b23f6 Change default backend of PyTorch Estimator to spark (#6681)
* change backend

* update readme

* highlight install
2022-11-21 18:49:13 +08:00
Ruonan Wang
11cc260980 Nano : support InferenceOptimizer for keras (#6458)
* add optimizer.py

* fix style

* set version for mypy

* add thread control for quantize, support openvino pot

* update optimizer

* fix typo

* update workflow

* temp commit

* modify ut

* refactor optimizer

* rebase, update based on comments
2022-11-18 09:39:12 +08:00
Junwei Deng
022d8d661c Chronos: add a how to guide to help users replay their forecaster with pre/post processing in production env (#6258)
* add notebook

* add updates

* rm output

* fix link

* add fix

* fix index
2022-11-17 19:28:34 +08:00
Yishuo Wang
62694b420e Nano: fix onnx quantization document issue (#6662) 2022-11-17 15:34:45 +08:00
Qiyuan Gong
b75f399038 [PPML] Add UEFI warning (#6646)
* Add UEFI warning for attestation
2022-11-17 08:51:51 +08:00
Jiao Wang
34f20c01cc [PPML] Azure support for Gramine (#6550)
* azure support

* update

* add simple example

* update

* update
2022-11-16 15:04:10 -08:00
Hu, Zhaojie
a5d72a34c8 Chronos: Update Windows User Guide (#6385)
* update win user guide (first commit)

* add ipex message

* update

* update

* update prophet

* update inc version and known issue

* fix format

* add inc install issue

* add inc install issue

* update install page

* fix typo

* fix typo

* update description

* make prophet available on windows & add prophet issue in known issue

* update install panel

* update install panel

* fix message

* fix message

* fix message

* fix message

* fix typo

* fix install cmd for stable release

* give each known issue a name
2022-11-16 10:43:47 +08:00
Hu, Zhaojie
607db04ad7 [Nano] Openvino model inference notebook example with Nano (#5745)
* add nano notebook example for openvino ir

* add basic example for openvino model inference

* add notebook example for sync inference and async inference

* add notebook to documentation

* update explanation for async api

* try to fix code snip

* fix code snip

* simplify async api explanation

* simplify async api explanation

* adapt new theme
2022-11-16 10:10:07 +08:00
Cengguang Zhang
4169d8cb05 Doc: fix spark-submit command for yarn client and cluster mode. (#6595)
* fix: fix yarn client and cluster spark submit command.

* fix: add properties to cluster mode spark submit command and related description.
2022-11-14 20:41:03 +08:00
Kai Huang
c80bb4b876 Expose k8s tutorial to docs (#6596) 2022-11-14 20:35:38 +08:00
binbin Deng
1e5d51f2be Chronos: add serving forecaster example in document (#6218) 2022-11-14 15:10:54 +08:00
Juntao_Luo
9cc933bb18 Chronos: Add forecasters filter tags in tutorial page. (#6068)
* Update: add forecaster tags in tutorial page.

* Bugfix: fix model tag bug.

* Update: update js with pr comment.
2022-11-14 11:10:34 +08:00
Cengguang Zhang
2904af55ed Doc: update orca-in-5-mins prediction. (#6554)
* fix: update orca-in-5-mins dataset volume.

* fix: update predict stage.
2022-11-14 11:07:07 +08:00
Cengguang Zhang
1453e5c244 Doc: Update orca hadoop user guide. (#6574)
* fix: update log filepath and branch.

* feat: update user guide.

* fix: update hadoop user guide

* fix: update hadoop user guide
2022-11-14 09:35:39 +08:00
Ruonan Wang
dbce8f13e0 Chronos : How to preprocess my data guide (#6446)
* add introduction

* finish basic version

* update nblink

* update based on comments

* update css
2022-11-11 16:30:15 +08:00
Kai Huang
9c99751288 Update Orca 5min (#6524) 2022-11-10 10:57:19 +08:00
Kai Huang
7da102243e Update Orca install doc (#6518)
* update install

* update

* update

* update link

* update 5min

* update 5mins

* update link
2022-11-10 10:28:46 +08:00
Qiyuan Gong
17fb75f8d7 [PPML] Refine readthedoc lines and space (#6509)
* Remove empty lines
* Use same space for indent
* Add empty line at the end
2022-11-09 13:41:21 +08:00
Juntao_Luo
4f3c27bde0 Chronos: upload prediction how-to-guide. (#5959)
* Upload:how_to_use_forecaster_to_predict_future_data how to guide.

* Update: update hyperlink in notebook.

* Update: update how-to-guide

* Update: update guide with pure prediction.

* tmp save

* test

* update how to predict

* make cell hidden

* update

* update toc

* update based on coments

Co-authored-by: ruoan1.wang <ruonan1.wang@intel.com>
2022-11-09 09:20:19 +08:00
Qiyuan Gong
a46618844f [PPML] Add mermaid to deployment and installation doc (#6497)
* Fix deployment doc mermaid.
* Add PCCS network to installation doc.
2022-11-09 08:57:17 +08:00
David smurf
4403c7727f Chronos: forecaster save/load how-to guide (#5684)
* how to save and load forecaseter

* add  doc of forecaster save and load

* update save and load notebook

* update notebook

* update link

* fix typo

Co-authored-by: ruoan1.wang <ruonan1.wang@intel.com>
2022-11-08 21:49:23 +08:00
Qiyuan Gong
0a49cd03bf [PPML] Reorg Readthedoc tutorial & menu (#6476)
* Change User Guide to Introduction
* Add Installation
* Refine toc and examples
* Refine title
* Add FAQs for Installation
2022-11-08 16:26:59 +08:00
Kai Huang
1e7681325b Update yarn tutorial (#6456)
* update yarn tutorial

* style

* update

* revert

* minor
2022-11-07 13:58:58 +08:00
Cengguang Zhang
5346ef45d8 Orca: update orca-in-5-minutes to tf2 estimator. (#6404)
* feat: update orca-in-5-minutes to tf2 estimator.

* fix: fix code and tensorflow version.

* fix: fix typo.

* fix: add config in estiamtor construction.

* feat: add random split to dataframe.

* fix: fix typo.

* feat: add test data in fit.

* fix: update link branch to main

* fix: fix typo.
2022-11-04 16:46:09 +08:00
Yuwen Hu
7cb86aeddd [Doc] Enable Mermaid diagrams in our documentation (#6450)
* Add sphinxcontribute-mermaid extension

* Add manual link for mermaid.js

* Load mermaid.js before require.js to avoid errors

* Update documentation guide for the usage of mermaid diagram in our doc

* Resolve error caused by double loaded mermaid.js

* Small fixes

* Small fix based on comments
2022-11-04 15:38:15 +08:00
Cengguang Zhang
916fdecd27 Orca: Document polishing (#6382)
* fix: delete redundant quick examples.

* feat: add How-to Guides with use cases.

* fix: _toc.yml

* fix: fix typo.

* fix: fix typo and file location.

* fix: add quickstarts to _toc.yml
2022-11-04 15:02:37 +08:00
liangs6212
29e9c18c70 Chronos: Make known issue page more friendly (#6321)
* make known issues more friendly

* resettitle size

* add new line

* fix style

* fix style again

* fix style again

* fix known issues
2022-11-04 14:43:50 +08:00
Hu, Zhaojie
84f5106a73 [Chronos]: Add how-to guides for exporting torchscript files to disk (#6319)
* add how-to guide for exporting to torchscript files

* fix nblink

* update description

* add onnxruntime-extensions
2022-11-04 14:41:42 +08:00
Jiao Wang
85445fdd39 add support for acr (#6440) 2022-11-03 19:09:16 -07:00
Junwei Deng
654baef1a3 Nano: refactor inference optimizer code for better code reuse (#6330)
* add base optimizer for future InferenceOptimizer keras

* fix type

* add type change

* change doc
2022-11-02 11:07:57 +08:00
Qiyuan Gong
c9b06eb431 [PPML] Add MP Auto and warning (#6395)
* Add MP Auto in BIOS
* Add warning for installation from binary
2022-11-02 09:07:30 +08:00
Jiao Wang
4dac556c68 [PPML] Update documentation of PPML Occlum on Azure (#6372)
* update with Azure Marketplace

* update

* update
2022-10-31 18:59:07 -07:00
Junwei Deng
2629bb0645 Chronos: fix the installation guide link (#6322) 2022-10-31 17:27:38 +08:00
Yuwen Hu
95ef573fc4 [Doc] Add contributor guide for writing new documentation (#6254)
* Revise toc tree & add draft version for document guide

* Add more contents and revise documentation guide

* Rename new file for documentation guide

* Add some new contents and try to change html tables to plain text tables for generated styles

* Change back to html table with specified css

* Add some new contents and small revision

* Revise contributor index page

* Minor typo fixes for landing page quicklinks

* Revise based on comments

* Add rst card components and small revisions
2022-10-31 16:29:25 +08:00
Xiangyu Tian
df3c04199f Add BigDL-PPML-Azure-Occlum-Example to readthedocs (#6292)
* Init

* Refine

* Refine

* Fix
2022-10-27 16:50:34 +08:00
Xin Qiu
aea43b44d4 update VFL HE document (#6262)
* Create vfl_he

* Rename vfl_he to vfl_he.md

* upload fl_ckks.PNG

* Update vfl_he.md

* Update vfl_he.md

* Update overview.md
2022-10-26 08:23:12 +08:00
Hu, Zhaojie
662628f4db Chronos: Add how-to guides for exporting ONNX/OpenVINO files to disk (#6234)
* create how-to guides for export model files to onnx/openvino

* add how to export onnx files

* add to doc

* hide the training process

* fix

* add how to export openvino files

* fix onnx

* fix nblink

* fix onnx

* change import

* fix onnx

* update some descriptions

* update yml file
2022-10-25 16:24:35 +08:00
Juntao_Luo
39bd960e2a Bugfix: fix chronos installation panel cmd line overflow. (#6276) 2022-10-25 14:16:08 +08:00
Yuwen Hu
89f97fed01 Move in-file toc to yml file except for API related toc (#6273) 2022-10-25 11:00:57 +08:00
Kai Huang
b4d01ac706 Update Orca install guide (#6268)
* update install

* fix link

* minor
2022-10-24 18:49:12 +08:00
Kai Huang
ea164651ee Polish Orca Doc (#6266)
* fix doc

* add tutorial index

* remove

* fix

* remove

* update
2022-10-24 18:03:39 +08:00
Ruonan Wang
100f2df428 update doc (#6261) 2022-10-24 14:55:23 +08:00
Yishuo Wang
6a8cdd71de fix torch_nano document link error and small change (#6257) 2022-10-24 14:04:02 +08:00
Ruonan Wang
f54b9b1915 Nano : update installation guide to nightly-build version (#6203)
* update install.md

* update examples

* update doc based on comments

* update link
2022-10-24 14:01:29 +08:00
Yuwen Hu
f5ef76acf3 [Doc] Add collapsing functionality to the quicklink titles in landing page (#6225)
* Make sidebar titles in landing page collapsed

* Remove 'Slow PyTorch training with BF16' section in windows user guide
2022-10-24 10:52:47 +08:00
Hu, Zhaojie
a0fa1694b5 [Nano] : Add howto guides for InferenceOptimizer.optimize (#6136)
* howto guide for InferenceOptimizer

* fix format in notebook

* rename notebook & add github workflow

* fix doc issue

* fix notebook

* fix typo

* remove ipykernel

* update notebook

* adapt new theme

* fix typo & remove necessary numpy
2022-10-22 10:44:50 +08:00
Qiyuan Gong
5ed2a33072 [PPML] Deployment with customer image (#6132)
* PPML deployment in 2 stages
* Add MRENCLAVE plot
* Add attestation
* Add index
2022-10-21 22:08:54 +08:00
Kai Huang
f98a8612c6 Add YARN tutorial to docs (#6242)
* add yarn to docs

* modify

* meet review

* modify style

* minor

* change #

* minor
2022-10-21 17:08:16 +08:00
CharleneHu94
5e4c269a49 [PPML] TPC-DS doc upadte (#6238)
* ppml tpcds doc update

* fix

* update data generation step
2022-10-21 17:01:37 +08:00
Yuwen Hu
0407ebf5c3 [Doc] Remove manually-added bold styles for titles (#6215)
* Remove manually-added bold style for titles in [User guide] section

* Fix failed relative links in windows user guide

* Remove manually-added bold style for titles in [Orca] section

* Fix failed relative links & title bold fix in Nano 5 min

* Remove manually-added bold style for titles in [Nano] section

* Remove manually-added bold style for titles in [DLlib] section

* Remove manually-added bold style for titles in [Chronos] section

* Remove manually-added bold style for titles in Developer guide

* Remove manually-added bold title style for all other not-included md files in docs/readthedocs/source/doc folder

* Fix based on comments
2022-10-20 13:48:22 +08:00
Yishuo Wang
7b28b3fd20 Nano: Rename strategy parameter of TorchNano to distributed_backend (#6126) 2022-10-20 09:16:55 +08:00
Qiyuan Gong
d36e7c4ff3 [PPML] Add BIOS conf & 1 known issues for installing SGX driver (#6206)
* Add BIOS configuration. 
* Add memory check for SGX, i.e., `Installed Memory = Total Memory + 2 * PRMRR`.
* Add BTF issues for installing SGX driver.
* Refine 2 known issue solutions.
2022-10-20 09:05:26 +08:00
Yuwen Hu
65cb3720f5 [Doc] Revise tooltips on decision tree and small fixes (#6197)
* Revise tooltips of decision tree

* Small list indent problem fix
2022-10-19 15:45:39 +08:00
Qiyuan Gong
b5d7b3183c [PPML] Refine SGX Driver installation doc (#6167)
* Add install from install package
* Rename file to install_sgx_driver
* Rename title to Install SGX Driver on Xeon Server
* Add vmlinux-gdb issue
2022-10-19 14:42:35 +08:00
Junwei Deng
6a7ab76a8e Nano: add a patch_torch/patch_tensorflow API for friendly usage (#5946)
* add a prototype code

* add patch_nano

* add pep8 changes

* add cv ppl

* fix bug

* add unpatch

* add updates

* update comment

* add changes

* add doc

* update and refactor

* update test

* fix doc

* fix according to cmt

* fix style

* fix doc

* fix bug

* fix style

* fix bug

* fix code

* add split patching api

* fix doc

* patch api to each framework

* fix pep8

* fix style

* fix style and cmt
2022-10-19 14:29:24 +08:00
Shengsheng Huang
f2e4c40cee change the readthedocs theme and reorg the sections (#6056)
* refactor toc

* refactor toc

* Change to pydata-sphinx-theme and update packages requirement list for ReadtheDocs

* Remove customized css for old theme

* Add index page to each top bar section and limit dropdown maximum to be 4

* Use js to change 'More' to 'Libraries'

* Add custom.css to conf.py for further css changes

* Add BigDL logo and search bar

* refactor toc

* refactor toc and add overview

* refactor toc and add overview

* refactor toc and add overview

* refactor get started

* add paper and video section

* add videos

* add grid columns in landing page

* add document roadmap to index

* reapply search bar and github icon commit

* reorg orca and chronos sections

* Test: weaken ads by js

* update: change left attrbute

* update: add comments

* update: change opacity to 0.7

* Remove useless theme template override for old theme

* Add sidebar releases component in the home page

* Remove sidebar search and restore top nav search button

* Add BigDL handouts

* Add back to homepage button to pages except from the home page

* Update releases contents & styles in left sidebar

* Add version badge to the top bar

* Test: weaken ads by js

* update: add comments

* remove landing page contents

* rfix chronos install

* refactor install

* refactor chronos section titles

* refactor nano index

* change chronos landing

* revise chronos landing page

* add document navigator to nano landing page

* revise install landing page

* Improve css of versions in sidebar

* Make handouts image pointing to a page in new tab

* add win guide to install

* add dliib installation

* revise title bar

* rename index files

* add index page for user guide

* add dllib and orca API

* update user guide landing page

* refactor side bar

* Remove extra style configuration of card components & make different card usage consistent

* Remove extra styles for Nano how-to guides

* Remove extra styles for Chronos how-to guides

* Remove dark mode for now

* Update index page description

* Add decision tree for choosing BigDL libraries in index page

* add dllib models api, revise core layers formats

* Change primary & info color in light mode

* Restyle card components

* Restructure Chronos landing page

* Update card style

* Update BigDL library selection decision tree

* Fix failed Chronos tutorials filter

* refactor PPML documents

* refactor and add friesian documents

* add friesian arch diagram

* update landing pages and fill key features guide index page

* Restyle link card component

* Style video frames in PPML sections

* Adjust Nano landing page

* put api docs to the last in index for convinience

* Make badge horizontal padding smaller & small changes

* Change the second letter of all header titles to be small capitalizd

* Small changes on Chronos index page

* Revise decision tree to make it smaller

* Update: try to change the position of ads.

* Bugfix: deleted nonexist file config

* Update: update ad JS/CSS/config

* Update: change ad.

* Update: delete my template and change files.

* Update: change chronos installation table color.

* Update: change table font color to --pst-color-primary-text

* Remove old contents in landing page sidebar

* Restyle badge for usage in card footer again

* Add quicklinks template on landing page sidebar

* add quick links

* Add scala logo

* move tf, pytorch out of the link

* change orca key features cards

* fix typo

* fix a mistake in wording

* Restyle badge for card footer

* Update decision tree

* Remove useless html templates

* add more api docs and update tutorials in dllib

* update chronos install using new style

* merge changes in nano doc from master

* fix quickstart links in sidebar quicklinks

* Make tables responsive

* Fix overflow in api doc

* Fix list indents problems in [User guide] section

* Further fixes to nested bullets contents in [User Guide] section

* Fix strange title in Nano 5-min doc

* Fix list indent problems in [DLlib] section

* Fix misnumbered list problems and other small fixes for [Chronos] section

* Fix list indent problems and other small fixes for [Friesian] section

* Fix list indent problem and other small fixes for [PPML] section

* Fix list indent problem for developer guide

* Fix list indent problem for [Cluster Serving] section

* fix dllib links

* Fix wrong relative link in section landing page

Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
Co-authored-by: Juntao Luo <1072087358@qq.com>
2022-10-18 15:35:31 +08:00
pinggao187
8e0d589845 update spark3.1.2 to spark3.1.3 (#6154)
* update spark3.1.2 to spark3.1.3

* uodate
2022-10-18 15:35:08 +08:00
Jiao Wang
e28edad625 [PPML] Azure PPML on graphene update (#6041)
* fix scripts and docs

* update

* add simple query to examples

* update

* update script

* update

* update

* update

* update

* update

* update
2022-10-17 18:43:23 -07:00
Guoqiong Song
8ea2907647 dllib doc fix (#6147) 2022-10-17 17:18:53 -07:00
joan726
daf86e9747 Update blogs.md (#6111) 2022-10-14 15:27:06 +08:00
binbin Deng
bde2f0930a Chronos: change import path of get_public_dataset (#6075)
* first commit

* fix
2022-10-14 09:58:38 +08:00
Hu, Zhaojie
4d56ece258 [Chronos] Add install options in chronos-nightly docker image (#6064)
* add install options for chronos dockerfile

* add invaild argument check

* add arg num check & add extra_dep arg

* remove debug message

* add build args message in README & change arg num check message

* add ml option in arg model

* add default value for each build arg

* update readme and howto guides

* fix typo

* fix typo

* fix markdown

* fix markdown
2022-10-13 22:20:28 +08:00
Shengsheng Huang
fbd5a57f93 add windows user guide (#5950)
* add windows user guide

* modifiy win user guides

* Add jupyter setup guide and known issues

* Add tips for yolov3 example

* update win guide

* update win guide

* update win guide reference

* update win guide reference

* update win guide reference

* format fix

* revise nano and chronos windows guide

* fix windows guide reference in nano install

Co-authored-by: aixideng <aixi.deng@intel.com>
2022-10-11 13:14:40 +08:00
Junwei Deng
28acefdb7c Chronos: update installation guide to reflect our work on better tensorflow support (#6066) 2022-10-10 17:31:02 +08:00
Song Jiaming
42934c9abe PPML refine keras VFL support (#6059) 2022-10-10 15:13:29 +08:00
Song Jiaming
b7be0c8c44 PPML FL document (#6017) 2022-10-08 10:22:32 +08:00
Jian Zhou
936f8d2adb update databricks doc (#6035)
Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-30 17:03:30 +08:00
Yuwen Hu
d262848421 [Document] Add API docs for bigdl.nano.tf.keras.layers.Embedding and bigdl.nano.tf.optimizers.SparseAdam (#5967)
* Add api docs for bigdl.nano.tf.keras.layers.Embedding and bigdl.nano.tf.optimizers.SparseAdam

* Update API document link in related how-to guide

* Remove non-related parameter explanation for Embedding

* Add param explanation for kwargs in for Embedding, and small revision

* Small fix
2022-09-30 13:14:42 +08:00
Ruonan Wang
f3c8ae37f1 Chronos : How to generate confidence interval for prediction (#5817)
* first commit

* fix version conflict in colab

* update based on comment

* change val_data to validation_data

* remove exit()
2022-09-28 14:34:20 +08:00
Shaojie Cui
27587b5db5 [PPML]doc: fix TPCH markdown list number render (#5992)
* Fix list number rendering wrongly

* position of the ellipsis
2022-09-28 11:07:48 +08:00
Jian Zhou
a703ae4eba Update Databricks user guide (#5920)
* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-28 09:47:18 +08:00
Yang Wang
0d696fcf92 Add tensorflow known issue for inter op parallelism cannot be modified (#5923)
* Add tensorflow known issue for inter op parallelism cannot be modified

* try clear session

* remove clear session
2022-09-27 10:45:43 -07:00
Le-Zheng
b9c73c4c20 add release link on main (#5981)
* add release link on main

* Update release.md
2022-09-27 16:58:35 +08:00
Qiyuan Gong
97b925e584 [PPML] Refine install SGX driver from Kernel document (#5978)
* Add Mellanox issue
* Add SYSTEM_REVOCATION_KEYS issue
* Fix typo
* Add libelf-dev
2022-09-27 15:55:04 +08:00
SONG Ge
79f29244d8 [Orca] Add bigdl-submit mode support (#5960)
* add bigdl-submit mode support

* modify all submit-with-bigdl

* remove submit-with-bigdl info
2022-09-27 15:17:41 +08:00
Yuwen Hu
331c3054d9 [Nano] How-To Guides: Training - TensorFlow (#5836)
* Add basic guides structure of Training - TensorFlow

* Add how-to guides: How to accelerate a TensorFlow Keras application on training workloads through multiple instances

* Change import order and add pip install for tensorflow-dataset

* Diable other nano tests for now

* Add github action tests for how-to guides Tensorflow training

* Use jupyter nbconvert to test notebooks for training tensorflow instead to avoid errors

* Add how-to guide: How to optimize your model with a sparse Embedding layer and SparseAdam optimizer

* Enable other nano tests again

* Small Revision: fix typos

* Small Revision: refactor some sentences

* Revision: refactor contents based on comments

* Add How-to guides: How to choose the number of processes for multi-instance training

* Small Revision: fix typos and refactor some sentences

* Make timeout time for github action longer for TensorFlow, 600s->700s
2022-09-26 15:40:22 +08:00
pinggao187
0cabc79133 change spark313 to spark312 (#5956) 2022-09-26 15:18:54 +08:00
Ruonan Wang
55c793c455 Nano : Update pytorch inference QuickStart with InferenceOptimizer (#5899)
* replace Trainer with InferenceOptimizer

* add warning note for deprecation of trainer.trace / trainer.quantize
2022-09-26 09:52:34 +08:00
pinggao187
0af2711dbf update pypi/spark version (#5925) 2022-09-23 14:30:49 +08:00
Qiyuan Gong
db2f80fbd8 [PPML] Refine grammar of PPML readthedoc (#5875)
* Refine grammar of secure_your_services, trusted_fl, secure_your_services, trusted_big_data_analytics_and_ml and ppml.
2022-09-21 10:37:07 +08:00
Ruonan Wang
13e3137cfd Fix a bug of readthedocs about get_public_dataset (#5808) 2022-09-19 09:12:25 +08:00
Jian Zhou
5c453157de update Databricks user guide (#5779)
* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-16 10:31:55 +08:00
Jiao Wang
a1c9182515 [PPML] Fix BigDL Graphene Azure scripts (#5767)
* update

* update submit scripts
2022-09-15 18:47:38 -07:00
binbin Deng
88faa59eb4 Chronos: how to evaluate using forecaster (#5710) 2022-09-16 09:06:27 +08:00
Cengguang Zhang
de91a8ccd7 Doc: add ray port FAQ to ray overview document. (#5752)
* feat: add faq to ray overview doc.

* fix: fix doc style.

* fix: fix typo.

* feat: add ray redis and dashboard port conflict to faq.

* fix: fix redis port param name.

* fix: fix redis port param name.

* fix: fix typo

* fix: fix typo

* fix: fix wording.
2022-09-15 19:26:10 +08:00
Ruonan Wang
edcab051a9 Nano : add API for InferenceOptimizer and deprecated some Trainer APIs (#5768)
* add api and deprecated

* add license

* add deprecated

* update comment for api display

* modify comment

* update based on comment
2022-09-15 18:43:47 +08:00
Shaojie Cui
d07e862bec PPML: mod TPCH document (#5583)
* doc: modify markdown grammar typo

* doc: md typo

* typo

* fix

* fix

* fix

* hint

* correct argument

* add path of password to container

* fix syntax errors

* fix

* fix
2022-09-15 16:27:09 +08:00
Yuwen Hu
12c12a1058 [Nano] How-To Guides: Training - PyTorch Lightning (#5643)
* Rearrange file structure for PyTorch Inference for docs and add titles for PyTorch-Lightning Training

* Add How-to guide: How to accelerate a PyTorch-Lightning application on training workloads through Intel® Extension for PyTorch*

* Add how-to guide: How to accelerate a PyTorch-Lightning application on training workloads through multiple instances

* Revise: remove '-' in 'PyTorch-Lightning' and some other changes

* Add How-to guides: How to use the channels last memory format in your PyTorch Lightning application for training

* Add how-to guide: Use BFloat16 Mixed Precision for PyTorch Lightning Training

* Add How-to guide: How to accelerate a computer vision data processing pipeline

* Small Revision: change comments in several code cells

* Disable other nano tests temporarily

* Add github action tests for Nano Training PyTorch Lightning tests

* Enable other nano tests again

* Small revisions: typos and explanation texts changes

* Revise: update based on comments
2022-09-15 15:26:11 +08:00
Wang Jian
528ff064f5 [PPML] Remove XGBoost from PPML guide 2022-09-15 12:03:40 +08:00
ZehuaCao
732850ef3a [PPML] change KMS appkey to apikey (#5658)
* change appkey to apikey

* change APiKEY to APIKEY

Co-authored-by: Heyang Sun <60865256+Uxito-Ada@users.noreply.github.com>
2022-09-13 15:44:23 +08:00
Junwei Deng
6b337b92be Chronos: how to guide page cleaning (#5657)
* update

* add nblink

* windows guide fix

* add some updated

* update chronos

* add update image

* add new image

* add updates

* add update

* add new image

* fix typo

* fix notebook location

* add new index

* update

* fix some doc

* update tree

* fix typo
2022-09-11 17:51:13 +08:00
David smurf
c73fc9f6ad Chronos: train tcn model on gpu and speed up inference on cpu (#5594)
* add nano_gpu

* simplify the code

* simplify the code

* modify the code

* add some updates

* add document

Co-authored-by: theaperdeng <theaperdeng@outlook.com>
2022-09-09 13:07:22 +08:00
Kai Huang
dcff01690b Add Ray arguments in init_orca_context to Doc page (#5686)
* add ray docs

* fix

* fix

* fix style

* minor
2022-09-08 18:18:18 +08:00
binbin Deng
103546d8fe Chronos: how to speedup inference on one node (onnx, openvino) (#5556)
* how to speedup inference on one node

* index added

* fixed

* fixed

* split to 2 guides

* add build_onnx and build_openvino

* add note border

* fix

* fix colab conflict

Co-authored-by: binbin <binbin1.deng@intel.com>
2022-09-07 17:53:38 +08:00
liangs6212
46b0fda3ca Chronos: how to create a forecaster (#5172)
* how to guide from_tsdataset

* improve md

* remove redundant message

* fix known issues

* add rst

* move create-forecaster to new line

* fix known issue

* fix syntax error

* fix syntax error again

* add open-colab icon

* fix known issues

* fix some words

* fix typo

* fix syntax error

* add some update

Co-authored-by: theaperdeng <theaperdeng@outlook.com>
2022-09-07 14:44:06 +08:00
Yishuo Wang
62b8aa8703 fix nano UT (#5650) 2022-09-06 17:09:31 +08:00
binbin Deng
01ec6107f8 Chronos: make roll=True the default value for to_torch_data_loader (#5605) 2022-09-06 09:28:03 +08:00
Ruonan Wang
2f1f3ba114 Chronos : Penalize underestimation example (#5627)
* add example

* remove valid dataset

* fix typo

* modify parameters and graph

* update based on comment

* modify index link

* modify js

* update
2022-09-02 15:46:12 +08:00
Yuwen Hu
30dd0bd6c2 [Nano] Nano How-to Guides: Format & PyTorch Inference (#5480)
* Create doc tree index for Nano How-to Guides

* Add How to guide for PyTorch Inference using ONNXRuntime

* Add How to guide for PyTorch Inference using OpenVINO

* Update How to guide for PyTorch Inference using OpenVINO/ONNXRuntime

* Change current notebook to md and revise contents to be more concentrated

* Add How-to Guide: Install BigDL-Nano in Google Colab (need further update)

* Revise words in How-to Guide for PyTorch Inference using OpenVINO/ONNXRuntime

* Add How-To Guide: Quantize PyTorch Model for Inference using Intel Neural Compressor

* Add How-To Guide: Quantize PyTorch Model for Inference using Post-training Quantization Tools

* Add API doc links and small revision

* Test: syncronization through marks in py files

* Test: syncronization through notebook with cells hidden from rendering in doc

* Remove test commits for runnable example <-> guides synchronization

* Enable rendering notebook from location out of sphinx source root

* Update guide "How to accelerate a PyTorch inference pipeline through OpenVINO" to notebook under python folder

* Update guide "How to quantize your PyTorch model for inference using Intel Neural Compressor" to notebook under python folder

* Fix bug that markdown will be ignored inside html tags for nbconvert, and notebook revise

* Update guide 'How to quantize your PyTorch model for inference using Post-training Optimization Tools' to notebook under python folder

* Small updates to index and current guides

* Revision based on Junwei's comments

* Update how-to guides: How to install BigDL-Nano in Google Colab, and update index page

* Small typo fix
2022-09-02 10:17:06 +08:00
Cengguang Zhang
f8f717a684 Doc: update hadoop document. (#5623)
* doc: update hadoop document.

* fix: fix wording.

* fix: fix wording.

* fix: fix wording.
2022-09-02 08:05:43 +08:00
Juntao_Luo
0f1cfd82ff Chronos: installation panel enhancement (#5588)
* Update:installation panel enhancement
Left a bug to fix and install CMD to revise.

* Bugfix: Fixed a bug when using Firefox browser to use the install guide form.
Fixed the bug that the table's background color may be changed by mistake on Firefox browser.

* Update: update panel as comment required.

* Bugfix: fixed a bug in js file that will show wrong cmd when clicking 'windows' or 'docker'.

* Bugfix: fixed the bug that 'cmd' shows incorrectly when clicking 'prophet' and 'ARIMA'.
2022-09-01 21:11:59 +08:00
Yuwen Hu
57e46c6160 [Documentation] Add Extension nbsphinx-link (#5596)
* Add extension nbsphinx-link: link notebook out of the sphinx root folder to the sphinx project

* Link Notebook custom.ipynb directly from python folder to the sphinx project

* Link Notebook seq_and_func.ipynb directly from python folder to the sphinx project

* Small title fix

* Make interactive graphs visible in readthedocs webpage for seq_and_func.ipynb

* Regenerate outputs for custom.ipynb and remove parts of them
2022-09-01 11:54:24 +08:00
Jason Dai
9e76c7e16e Update powered-by.md 2022-08-31 21:20:56 +08:00
Jason Dai
692f79a1c7 Update powered-by.md 2022-08-31 20:57:42 +08:00
Ruonan Wang
3df26cc9ed Chronos : add [how to tune a forecaster model] notebook (#5399)
* add how_to_tune_a_forecaster_model notebook

* modify step1: data preparation

* update based how to train

* modify a bug of summary

* update based on comment

* move to howto

* fix typo

* add file

* update based on comments

* rename the tile
2022-08-30 22:24:49 +08:00
Cengguang Zhang
57d45e5deb Orca: add save and load model doc to PyTorch Estimator quick-start. (#5504)
* feat: add save and load model doc to pytorch estimator quickstart.

* fix: fix typo.

* fix: fix typo

* fix: fix typo.

* feat: add doc to ray backend quickstart

* fix: fix typo.

* feat: add doc to ray backend quickstart
2022-08-24 13:48:32 +08:00
Juntao_Luo
584ee6045c Chronos: update js, css and md files to add filter function in tutorial page. (#5506) 2022-08-23 12:50:29 +08:00
Cengguang Zhang
c94e934068 Orca: update known-issues. (#5505)
* fix: update known-issues.

* fix: fix wording.
2022-08-23 11:21:37 +08:00
Yuwen Hu
cc540d0c34 Update "Open in Colab" button in notebooks (#5452)
* Update open in colab button from HTML-style hyperlinks to markdown image with link for notebooks in readthedocs folder

* Update "Open in Colab" button for notebooks under python folder with markdown image with link
2022-08-18 14:55:20 +08:00
Yishuo Wang
e62b8d1fc5 Automatically unwrap attributes access of _LiteModule (#5392)
* automatically unwrap attributes access of _LiteModule and add test for it
* delete redundant documents
2022-08-18 10:57:52 +08:00
Qiyuan Gong
df75c72d91 Add Key generation suggestion into document (#5446)
* Add SSL and AES Key generation suggestion into document.
2022-08-17 22:55:53 +08:00
Chaselzxy
b11496db60 Chronos: How-to-Guides (How to train forecaster on single node) (#5224)
* how to train forecaster

* add a notebook

* add new notebook

* add index

* fix colab link

* change content

Co-authored-by: Xinyi Zhang <xinyi1.zhang@intel.com>
Co-authored-by: theaperdeng <theaperdeng@outlook.com>
2022-08-17 20:11:24 +08:00
Cengguang Zhang
241b0f1712 Docs: fix typo and quickstart code branch. (#5414) 2022-08-16 16:20:46 +08:00
Cengguang Zhang
6af23499e7 Docs: add save and load model docs. (#5397)
* docs: add save and load model docs.

* fix: update code style.

* fix: update code style.

* fix: fix typo and modify wording.

* docs: add save model example to notebook.

* fix: fix typo.
2022-08-16 15:23:30 +08:00
shaojie
611c9aefdf fix Notebook issues (#5344)
* fix Notebook issues

* update start-notebook scripts to add token and port parameter.

* update start notebook scripts

* test start notebook scripts and deployment yaml file

* update image tag to latest

* update deployment file,README and start-notebook script file

* update README

* update README

Co-authored-by: baishaojie <shaojiex.bai@intel.com>
2022-08-16 10:39:39 +08:00
Jason Dai
bdce772965 Update powered-by.md 2022-08-16 07:12:36 +08:00
Cengguang Zhang
2c0424e964 Docs: update orca known issues (#5395)
* docs: update known issues

* fix: add example to known issue

* fix: add example to known issue

* fix: fix typo

* fix: modify issue description.

* fix: fix typo.

* fix: fix typo.
2022-08-15 18:20:45 +08:00
Jiao Wang
a440a05b0c Azure PPML doc update (#5386)
* update

* update
2022-08-12 15:44:33 -07:00
Song Jiaming
362674ee1c Add a ssl/tls section of Secure Your Devices README (#5366)
* Add a ssl/tls section of Secure Your Devices README
2022-08-12 10:07:16 +08:00