Commit graph

584 commits

Author SHA1 Message Date
liangs6212
da7b30529b Nano: Update the Nano installation panel (#7015)
* update installation panel

* fix typo

* fix typo again

* fix typo

* experimental change

* fix typo

* fix known issues

* update

* update subsections

* update typo

* update according to comment

Co-authored-by: TheaperDeng <theaperdeng@outlook.com>
2022-12-26 15:43:36 +08:00
Yuwen Hu
37b0c6fa50 [Nano] How-To Guides: Convert to TorchNano & use @nano decorator (#5984)
* Add how to guide: How to convert your PyTorch code to use TorchNano for training acceleration

* Small nano how-to index format update for openvino inference

* Update based on comments

* Updated based on comments

* Add how-to guide: How to wrap a PyTorch training loop through @nano decorator

* Add reference to TorchNano guide in @nano guide

* Some small fixes and updates

* Small typo fix: bulit -> built

* Updates based on comments

* Remove validation dataloader based on comments

* Order change of two guides

* Update based on comments
2022-12-26 15:36:53 +08:00
Ruonan Wang
14cf4aff72 Nano: Troubshooting guide for BigDL-Nano (#6910)
* add troubshooting guide

* add more cases

* update style

* update

* update style

* update two cases

* update

* add two issue
2022-12-26 10:02:44 +08:00
Yuwen Hu
6bc720d26a [Nano] Add API doc for bigdl.nano.pytorch.nano decorator (#7068)
* Add Api doc for bigdl.nano.pytorch.nano decorator

* Fix Python styles

* Small fix

* Remove strange 'method' in InferenceOptimizer api doc
2022-12-26 09:25:57 +08:00
Ruonan Wang
935fc48354 Nano: update PyTorch inference key feature doc (#6938)
* upddate installation

* update

* update runtime acceleration

* update link in rst

* add bf16 quantization and optimize()

* update based on comment

* update

* update based on comment
2022-12-22 13:34:18 +08:00
Yishuo Wang
3b6c56b505 Nano: update nano known issue (#7063) 2022-12-22 09:53:05 +08:00
Yishuo Wang
0a62df22aa Nano: quick fix typo (#7064) 2022-12-21 16:31:15 +08:00
Junwei Deng
dea7b8f9f2 Nano: update train pytorch key feature doc (#6906)
* update train doc

* update train page
2022-12-19 15:51:19 +08:00
binbin Deng
217e8a1c2b Chronos: update python3.8 support in document (#6951)
* update

* update

* fix

* fix
2022-12-19 15:39:30 +08:00
Junwei Deng
f304d33168 Nano: add patching function for dtype (#6947)
* add patching function for dtype

* update

* fix pep8

* update the parameter name
2022-12-16 16:16:12 +08:00
Kai Huang
6b65968e3c Remove save entire model in doc (#6986) 2022-12-14 17:04:15 +08:00
Yuwen Hu
12487a4c5a Hide ALL_INFERENCE_ACCELERATION_METHOD in api doc rendering for bigdl.nano.tf.keras.InferenceOptimizer (#6973) 2022-12-14 13:01:53 +08:00
Ruonan Wang
b3feb53c4a Nano: add key feature and how to guide for context manager (#6897)
* add key feature and how to guide for context manager

* update key feature for multi models

* update based on comment

* update

* update based on comments

* update

* update
2022-12-13 16:57:52 +08:00
Cengguang Zhang
de88f1e6b3 doc: add load to pytorch estimator quickstart. (#6920)
* doc: add load to pytorch estimator quickstart.

* fix: fix style.

* fix typo

* fix wording.
2022-12-13 14:31:15 +08:00
Yishuo Wang
664dfbe7ef Nano: Add key feature and how to guide for multi-instance inference (#6901) 2022-12-13 14:18:26 +08:00
Ziyao Peng
99d6decfeb Orca docs: The mv command in the document k8s.md needs to be modified (#6939) 2022-12-13 10:51:43 +08:00
Hu, Zhaojie
9fae00dafd Chronos: Update doc to illustrate deploy mode in TSDataset (#6871)
* update doc to illustrate deploy mode

* fix

* revise howto guide
2022-12-13 09:44:30 +08:00
joan726
414c220111 Update presentations.md and powered-by.md (#6699) 2022-12-12 16:52:33 +08:00
Yishuo Wang
7e180d028e Nano: update tensorflow examples (#6935) 2022-12-12 13:56:05 +08:00
Ziyao Peng
56a2d8f1cd Orca docs: The mv command in the document needs to be modified (#6927)
* Update yarn.md

* Update yarn.md

* Update yarn.md

* Update yarn.md
2022-12-12 09:52:38 +08:00
binbin Deng
eceedbe196 Chronos: update benchmark tool guide to demonstrate new functions (#6882) 2022-12-09 17:34:44 +08:00
Cengguang Zhang
7a8bd4cee5 Doc: copy faq to known issues. (#6915)
* feat: copy faq to known issues.

* fix: add ray issues section.
2022-12-08 16:57:18 +08:00
Yishuo Wang
7e2742cace Nano: Update examples and tutorials (#6888) 2022-12-08 11:23:48 +08:00
Hu, Zhaojie
044785173e Chronos: Update chronos-nightly Dockerfile and notebook (#6899)
* update docker file and notebook

* fix comment

* fix comment
2022-12-08 09:45:55 +08:00
liangs6212
ae7160790d Doc: Nano installation panel (#6852)
* add nano installation panel

* try fix

* try fix again

* fix typo

* add versions

* try fix second

* try fix second again

* fix col width

* rollback

* rollback again

* fix syntax error

* fix syntax error again

* fix syntax error last

* fix syntax

* fix syntax

* fix syntax again

* add some comment

* try fix

* try fix

* try fix again

* try fix

* fix typo

* fix some error

* fix typo

* some optimization

* change width

* change width again

* change width again

* change width again

* last width change

* fix description error

* change inference default to yes

* switch inferenceyes and inferenceno
2022-12-07 14:30:11 +08:00
Cengguang Zhang
b96d39db4a Orca: update yarn tutorial (#6857)
* doc: 1.  update yarn tutorial
2. upload deployment diagram.

* fix: code style.

* fix: remove unnecessary changes.

* fix: code style.

* fix: fix wording.

* fix: fix wording.
2022-12-02 17:09:53 +08:00
Shaojun Liu
207958dbad cicd: add pip mirror https://pypi.python.org/simple for bigdl related package (#6827)
* add pip mirror

* update

* typo
2022-12-01 20:47:36 +08:00
Kai Huang
fdcf509681 Update doc style (#6841)
* minor

* trial

* change to dot
2022-12-01 17:54:33 +08:00
Cengguang Zhang
536f84cc34 Doc: add how-to guides to navigation box. (#6842)
* feat: update index.rst.

* fix: fix order.

* fix: delete unecessary line.
2022-12-01 17:36:53 +08:00
Kai Huang
bf96cada20 Update yarn doc (#6840)
* update

* update

* update install

* minor
2022-12-01 16:54:35 +08:00
Junwei Deng
87507ba715 Nano: add partial m-series chip support for tensorflow (training and installation) (#6520)
* add m1 chip support

* fix setup
2022-11-30 13:18:00 +08:00
Jiao Wang
81a9f8147c [PPML] Azure Gramine documentation (#6627)
* update az gramine doc

* add python example

* update

* update

* update
2022-11-29 14:48:57 -08:00
Xiangyu Tian
bd112d6cf3 [PPML] Add Azure Attestation part to Attestation Basic Docs (#6781)
* Init

* Fix

* Refine

* Refine

* Refine
2022-11-28 16:08:36 +08:00
Yuwen Hu
c87c01bd8d [Doc] Update doc requirements link (#6780)
* Update doc requirements link in readthedocs yml file

* Update related doc README

* Small doc fix
2022-11-28 15:13:44 +08:00
Qiyuan Gong
3571247d65 [PPML] Attestation basic (#6778)
* Add attestation basic doc to readthedoc
2022-11-28 13:26:52 +08:00
Jason Dai
242de02c0e [Doc] Update document (#6772) 2022-11-28 10:26:36 +08:00
liangs6212
d25d67d3d7 Chronos: Fix the installation panel display error (#6767)
* try fix

* try fix again
2022-11-25 17:13:53 +08:00
WangJun
bf5ccae4ef [Nano] add how to guide save and load jit, ipex, onnx, openvino (#6659)
* add how to guide:
* acclerate with jit_ipex
* save and load jit, ipex, onnx, openvino
* add these five above .nblink files
;

* add index of sl files

* clear all the output & fix the bug of title

* remove extra blank indent

* format the jupter with prettier

* fix the bug of error words

* add blank line before unorder list

* * remove the normal inference in accelerate using jit/ipex;
* add note to example why we should pass in the orginal model to get the optimized one in sl ipex

* fix:new pip install shell cmd  & indent improve
2022-11-25 15:47:15 +08:00
liangs6212
cd04f7dbdc Chronos: Update installation panel for inference option (#6742)
* first commit

* add inference button

* fix typo

* fix typo again

* fix syntax error

* try fix

* rollback

* try fix again

* add comment

* fix installation error

* rename

* try fix

* rollback

* fix error

* fix error again

* try fix
2022-11-25 15:26:35 +08:00
Qiyuan Gong
621168ce2e [PPML] Move dev guide to tutorial (#6765)
* Move dev guide to tutorial & examples.
2022-11-25 15:02:11 +08:00
binbin Deng
df775d172e Chronos: benchmark tool user guide (#6668) 2022-11-25 11:25:34 +08:00
Qiyuan Gong
1b46df7e65 [PPML] Refine readthedoc development guide (#6685)
* Add migrate without code change.
* Add SGX/TDX design guide.
* Refine link & add description.
2022-11-25 08:36:47 +08:00
Cengguang Zhang
ebe75782dd Doc: add download link and script in orca installation. (#6750)
* feat: add download orca in installation.

* fix: fix wording.

* fix: fix typo.

* fix: fix wording.

* fix: fix link and add scripts.

* fix: fix wording.

* fix: fix wording.

* fix: add empty check for env variables.

* fix: fix echo.

* fix: update download link

* fix: fix style.

* fix: fix style.

* fix: fix wording and style.

* fix: fix style.

* fix: fix style.

* fix: fix style.
2022-11-24 16:40:57 +08:00
Yuwen Hu
988bdc18cf Remove DEFAULT_INFERENCE_ACCELERATION_METHODfor InferenceOptimizer.optimize pniapi doc (#6745) 2022-11-24 11:26:52 +08:00
Kai Huang
982d3ac786 Update PyTorch Estimator doc (#6727)
* update doc

* update code doc

* minor

* minor

* fix typo
2022-11-23 19:40:23 +08:00
Cengguang Zhang
745aaef5df Orca: update doc for pytorch estimator backend. (#6723)
* feat: update doc for pytorch estimator backend.

* fix: remove ray global dependency.

* rm: remove .swp file.

* fix: revert ray import fix.

* fix: replace model and optimizer with  model_creator and optimizer_creator.

* fix: delete unnecessary links.

* fix: update index.md

* fix: fix code style of quickstart and jupyter notebook.

* fix: remove criterion.

* fix: fix dataset description.

* fix: fix code style.

* fix: fix code style.

* fix: update batch size and link

* fix: update link

* fix: fix code style.

* fix: fix unnecessary code.

* fix: fix typo.

* fix: use relative path.

* fix: fix typo.

* fix: fix link.
2022-11-23 19:09:01 +08:00
Cengguang Zhang
ca3b088522 Doc: update sidebar and quickstarts order. (#6743)
* doc: update sidebar and quickstarts order.

* fix: adjust quickstart order.

* fix: fix typo.

* fix: fix typo.
2022-11-23 18:57:11 +08:00
Kai Huang
d0388cb8d8 Update K8s tutorial (part4) (#6724)
* update python

* update spark-submit
2022-11-22 19:51:04 +08:00
Cengguang Zhang
7f2beefb7b fix: update pytorch estimator backend. (#6721) 2022-11-22 16:50:33 +08:00
Kai Huang
e249e32c6f Update K8s tutorial (part3) (#6719) 2022-11-22 15:56:23 +08:00
Kai Huang
bb3889958c Update k8s tutorial (part2) (#6700) 2022-11-21 19:57:22 +08:00
Kai Huang
cdd1f8421e Update k8s tutorial (part1) (#6696)
* update 1.1

* update 3

* update 1.2 1.3
2022-11-21 19:01:30 +08:00
Kai Huang
78ee9b23f6 Change default backend of PyTorch Estimator to spark (#6681)
* change backend

* update readme

* highlight install
2022-11-21 18:49:13 +08:00
Kai Huang
83921263c8 Fix quick links (#6676)
* fix

* fix wording
2022-11-18 14:57:21 +08:00
Ruonan Wang
11cc260980 Nano : support InferenceOptimizer for keras (#6458)
* add optimizer.py

* fix style

* set version for mypy

* add thread control for quantize, support openvino pot

* update optimizer

* fix typo

* update workflow

* temp commit

* modify ut

* refactor optimizer

* rebase, update based on comments
2022-11-18 09:39:12 +08:00
Junwei Deng
022d8d661c Chronos: add a how to guide to help users replay their forecaster with pre/post processing in production env (#6258)
* add notebook

* add updates

* rm output

* fix link

* add fix

* fix index
2022-11-17 19:28:34 +08:00
Yishuo Wang
62694b420e Nano: fix onnx quantization document issue (#6662) 2022-11-17 15:34:45 +08:00
Yuwen Hu
8d6c43dd09 Mock module cpuinfo for fixing missing Nano/Chronos api doc (#6655) 2022-11-17 11:23:09 +08:00
Qiyuan Gong
b75f399038 [PPML] Add UEFI warning (#6646)
* Add UEFI warning for attestation
2022-11-17 08:51:51 +08:00
Jiao Wang
34f20c01cc [PPML] Azure support for Gramine (#6550)
* azure support

* update

* add simple example

* update

* update
2022-11-16 15:04:10 -08:00
Hu, Zhaojie
a5d72a34c8 Chronos: Update Windows User Guide (#6385)
* update win user guide (first commit)

* add ipex message

* update

* update

* update prophet

* update inc version and known issue

* fix format

* add inc install issue

* add inc install issue

* update install page

* fix typo

* fix typo

* update description

* make prophet available on windows & add prophet issue in known issue

* update install panel

* update install panel

* fix message

* fix message

* fix message

* fix message

* fix typo

* fix install cmd for stable release

* give each known issue a name
2022-11-16 10:43:47 +08:00
Hu, Zhaojie
607db04ad7 [Nano] Openvino model inference notebook example with Nano (#5745)
* add nano notebook example for openvino ir

* add basic example for openvino model inference

* add notebook example for sync inference and async inference

* add notebook to documentation

* update explanation for async api

* try to fix code snip

* fix code snip

* simplify async api explanation

* simplify async api explanation

* adapt new theme
2022-11-16 10:10:07 +08:00
Juntao_Luo
e85f836acc [Doc] Sidebar fix (#6610)
* Update: fix right sidebar word-break.

* Update: fix right sidebar word-break again.
2022-11-15 14:12:00 +08:00
Yuwen Hu
eaa5110db7 [Doc] Migrate requirements file for ReadtheDocs documentation building (#6602)
* Refactor readthedocs yml file to wget requirements-doc.txt for safety purposes

* Remove requirements-doc.txt from BigDL repo

* temp readme

* Remove requirements-rtd.txt and update README for local doc build

* Small typo fix
2022-11-15 10:00:49 +08:00
Cengguang Zhang
4169d8cb05 Doc: fix spark-submit command for yarn client and cluster mode. (#6595)
* fix: fix yarn client and cluster spark submit command.

* fix: add properties to cluster mode spark submit command and related description.
2022-11-14 20:41:03 +08:00
Kai Huang
c80bb4b876 Expose k8s tutorial to docs (#6596) 2022-11-14 20:35:38 +08:00
binbin Deng
1e5d51f2be Chronos: add serving forecaster example in document (#6218) 2022-11-14 15:10:54 +08:00
Juntao_Luo
9cc933bb18 Chronos: Add forecasters filter tags in tutorial page. (#6068)
* Update: add forecaster tags in tutorial page.

* Bugfix: fix model tag bug.

* Update: update js with pr comment.
2022-11-14 11:10:34 +08:00
Cengguang Zhang
2904af55ed Doc: update orca-in-5-mins prediction. (#6554)
* fix: update orca-in-5-mins dataset volume.

* fix: update predict stage.
2022-11-14 11:07:07 +08:00
Cengguang Zhang
1453e5c244 Doc: Update orca hadoop user guide. (#6574)
* fix: update log filepath and branch.

* feat: update user guide.

* fix: update hadoop user guide

* fix: update hadoop user guide
2022-11-14 09:35:39 +08:00
Ruonan Wang
dbce8f13e0 Chronos : How to preprocess my data guide (#6446)
* add introduction

* finish basic version

* update nblink

* update based on comments

* update css
2022-11-11 16:30:15 +08:00
Kai Huang
9c99751288 Update Orca 5min (#6524) 2022-11-10 10:57:19 +08:00
Kai Huang
7da102243e Update Orca install doc (#6518)
* update install

* update

* update

* update link

* update 5min

* update 5mins

* update link
2022-11-10 10:28:46 +08:00
Qiyuan Gong
17fb75f8d7 [PPML] Refine readthedoc lines and space (#6509)
* Remove empty lines
* Use same space for indent
* Add empty line at the end
2022-11-09 13:41:21 +08:00
Juntao_Luo
4f3c27bde0 Chronos: upload prediction how-to-guide. (#5959)
* Upload:how_to_use_forecaster_to_predict_future_data how to guide.

* Update: update hyperlink in notebook.

* Update: update how-to-guide

* Update: update guide with pure prediction.

* tmp save

* test

* update how to predict

* make cell hidden

* update

* update toc

* update based on coments

Co-authored-by: ruoan1.wang <ruonan1.wang@intel.com>
2022-11-09 09:20:19 +08:00
Qiyuan Gong
a46618844f [PPML] Add mermaid to deployment and installation doc (#6497)
* Fix deployment doc mermaid.
* Add PCCS network to installation doc.
2022-11-09 08:57:17 +08:00
David smurf
4403c7727f Chronos: forecaster save/load how-to guide (#5684)
* how to save and load forecaseter

* add  doc of forecaster save and load

* update save and load notebook

* update notebook

* update link

* fix typo

Co-authored-by: ruoan1.wang <ruonan1.wang@intel.com>
2022-11-08 21:49:23 +08:00
Qiyuan Gong
0a49cd03bf [PPML] Reorg Readthedoc tutorial & menu (#6476)
* Change User Guide to Introduction
* Add Installation
* Refine toc and examples
* Refine title
* Add FAQs for Installation
2022-11-08 16:26:59 +08:00
Kai Huang
1e7681325b Update yarn tutorial (#6456)
* update yarn tutorial

* style

* update

* revert

* minor
2022-11-07 13:58:58 +08:00
Cengguang Zhang
5346ef45d8 Orca: update orca-in-5-minutes to tf2 estimator. (#6404)
* feat: update orca-in-5-minutes to tf2 estimator.

* fix: fix code and tensorflow version.

* fix: fix typo.

* fix: add config in estiamtor construction.

* feat: add random split to dataframe.

* fix: fix typo.

* feat: add test data in fit.

* fix: update link branch to main

* fix: fix typo.
2022-11-04 16:46:09 +08:00
Yuwen Hu
7cb86aeddd [Doc] Enable Mermaid diagrams in our documentation (#6450)
* Add sphinxcontribute-mermaid extension

* Add manual link for mermaid.js

* Load mermaid.js before require.js to avoid errors

* Update documentation guide for the usage of mermaid diagram in our doc

* Resolve error caused by double loaded mermaid.js

* Small fixes

* Small fix based on comments
2022-11-04 15:38:15 +08:00
Cengguang Zhang
916fdecd27 Orca: Document polishing (#6382)
* fix: delete redundant quick examples.

* feat: add How-to Guides with use cases.

* fix: _toc.yml

* fix: fix typo.

* fix: fix typo and file location.

* fix: add quickstarts to _toc.yml
2022-11-04 15:02:37 +08:00
liangs6212
29e9c18c70 Chronos: Make known issue page more friendly (#6321)
* make known issues more friendly

* resettitle size

* add new line

* fix style

* fix style again

* fix style again

* fix known issues
2022-11-04 14:43:50 +08:00
Hu, Zhaojie
84f5106a73 [Chronos]: Add how-to guides for exporting torchscript files to disk (#6319)
* add how-to guide for exporting to torchscript files

* fix nblink

* update description

* add onnxruntime-extensions
2022-11-04 14:41:42 +08:00
Jiao Wang
85445fdd39 add support for acr (#6440) 2022-11-03 19:09:16 -07:00
Junwei Deng
250ea019bd Nano: fix torch version to enable nano API doc (#6429) 2022-11-03 18:14:54 +08:00
Junwei Deng
654baef1a3 Nano: refactor inference optimizer code for better code reuse (#6330)
* add base optimizer for future InferenceOptimizer keras

* fix type

* add type change

* change doc
2022-11-02 11:07:57 +08:00
Qiyuan Gong
c9b06eb431 [PPML] Add MP Auto and warning (#6395)
* Add MP Auto in BIOS
* Add warning for installation from binary
2022-11-02 09:07:30 +08:00
Jiao Wang
4dac556c68 [PPML] Update documentation of PPML Occlum on Azure (#6372)
* update with Azure Marketplace

* update

* update
2022-10-31 18:59:07 -07:00
Junwei Deng
2629bb0645 Chronos: fix the installation guide link (#6322) 2022-10-31 17:27:38 +08:00
Yuwen Hu
95ef573fc4 [Doc] Add contributor guide for writing new documentation (#6254)
* Revise toc tree & add draft version for document guide

* Add more contents and revise documentation guide

* Rename new file for documentation guide

* Add some new contents and try to change html tables to plain text tables for generated styles

* Change back to html table with specified css

* Add some new contents and small revision

* Revise contributor index page

* Minor typo fixes for landing page quicklinks

* Revise based on comments

* Add rst card components and small revisions
2022-10-31 16:29:25 +08:00
Qiyuan Gong
56fcec2314 [PPML] Fix deploy in production link (#6363)
* Fix deploy in production link. Thanks to @Oscilloscope98
2022-10-31 14:13:46 +08:00
Xiangyu Tian
df3c04199f Add BigDL-PPML-Azure-Occlum-Example to readthedocs (#6292)
* Init

* Refine

* Refine

* Fix
2022-10-27 16:50:34 +08:00
Xin Qiu
aea43b44d4 update VFL HE document (#6262)
* Create vfl_he

* Rename vfl_he to vfl_he.md

* upload fl_ckks.PNG

* Update vfl_he.md

* Update vfl_he.md

* Update overview.md
2022-10-26 08:23:12 +08:00
Hu, Zhaojie
662628f4db Chronos: Add how-to guides for exporting ONNX/OpenVINO files to disk (#6234)
* create how-to guides for export model files to onnx/openvino

* add how to export onnx files

* add to doc

* hide the training process

* fix

* add how to export openvino files

* fix onnx

* fix nblink

* fix onnx

* change import

* fix onnx

* update some descriptions

* update yml file
2022-10-25 16:24:35 +08:00
Juntao_Luo
6245a4525b Update: make sidebars sticky. (#6280) 2022-10-25 15:28:31 +08:00
Juntao_Luo
39bd960e2a Bugfix: fix chronos installation panel cmd line overflow. (#6276) 2022-10-25 14:16:08 +08:00
Yuwen Hu
89f97fed01 Move in-file toc to yml file except for API related toc (#6273) 2022-10-25 11:00:57 +08:00
Kai Huang
b4d01ac706 Update Orca install guide (#6268)
* update install

* fix link

* minor
2022-10-24 18:49:12 +08:00
Kai Huang
ea164651ee Polish Orca Doc (#6266)
* fix doc

* add tutorial index

* remove

* fix

* remove

* update
2022-10-24 18:03:39 +08:00
Yuwen Hu
a66e7adfe0 [Doc] Update README.md in docs/readthedocs folder (#6245)
* Update requirements-rtd.txt for local build consistent with readthedocs deployment

* Update doc readme for local building

* Small revision

* Small typo fixes
2022-10-24 17:40:46 +08:00
Ruonan Wang
100f2df428 update doc (#6261) 2022-10-24 14:55:23 +08:00
Yishuo Wang
6a8cdd71de fix torch_nano document link error and small change (#6257) 2022-10-24 14:04:02 +08:00
Ruonan Wang
f54b9b1915 Nano : update installation guide to nightly-build version (#6203)
* update install.md

* update examples

* update doc based on comments

* update link
2022-10-24 14:01:29 +08:00
Yuwen Hu
f5ef76acf3 [Doc] Add collapsing functionality to the quicklink titles in landing page (#6225)
* Make sidebar titles in landing page collapsed

* Remove 'Slow PyTorch training with BF16' section in windows user guide
2022-10-24 10:52:47 +08:00
Yuwen Hu
9576d97187 Fix overflow problems caused by long words (#6220) 2022-10-24 10:07:25 +08:00
Hu, Zhaojie
a0fa1694b5 [Nano] : Add howto guides for InferenceOptimizer.optimize (#6136)
* howto guide for InferenceOptimizer

* fix format in notebook

* rename notebook & add github workflow

* fix doc issue

* fix notebook

* fix typo

* remove ipykernel

* update notebook

* adapt new theme

* fix typo & remove necessary numpy
2022-10-22 10:44:50 +08:00
Qiyuan Gong
5ed2a33072 [PPML] Deployment with customer image (#6132)
* PPML deployment in 2 stages
* Add MRENCLAVE plot
* Add attestation
* Add index
2022-10-21 22:08:54 +08:00
Kai Huang
f98a8612c6 Add YARN tutorial to docs (#6242)
* add yarn to docs

* modify

* meet review

* modify style

* minor

* change #

* minor
2022-10-21 17:08:16 +08:00
CharleneHu94
5e4c269a49 [PPML] TPC-DS doc upadte (#6238)
* ppml tpcds doc update

* fix

* update data generation step
2022-10-21 17:01:37 +08:00
Yuwen Hu
0407ebf5c3 [Doc] Remove manually-added bold styles for titles (#6215)
* Remove manually-added bold style for titles in [User guide] section

* Fix failed relative links in windows user guide

* Remove manually-added bold style for titles in [Orca] section

* Fix failed relative links & title bold fix in Nano 5 min

* Remove manually-added bold style for titles in [Nano] section

* Remove manually-added bold style for titles in [DLlib] section

* Remove manually-added bold style for titles in [Chronos] section

* Remove manually-added bold style for titles in Developer guide

* Remove manually-added bold title style for all other not-included md files in docs/readthedocs/source/doc folder

* Fix based on comments
2022-10-20 13:48:22 +08:00
Yishuo Wang
7b28b3fd20 Nano: Rename strategy parameter of TorchNano to distributed_backend (#6126) 2022-10-20 09:16:55 +08:00
Qiyuan Gong
d36e7c4ff3 [PPML] Add BIOS conf & 1 known issues for installing SGX driver (#6206)
* Add BIOS configuration. 
* Add memory check for SGX, i.e., `Installed Memory = Total Memory + 2 * PRMRR`.
* Add BTF issues for installing SGX driver.
* Refine 2 known issue solutions.
2022-10-20 09:05:26 +08:00
Yuwen Hu
65cb3720f5 [Doc] Revise tooltips on decision tree and small fixes (#6197)
* Revise tooltips of decision tree

* Small list indent problem fix
2022-10-19 15:45:39 +08:00
Qiyuan Gong
b5d7b3183c [PPML] Refine SGX Driver installation doc (#6167)
* Add install from install package
* Rename file to install_sgx_driver
* Rename title to Install SGX Driver on Xeon Server
* Add vmlinux-gdb issue
2022-10-19 14:42:35 +08:00
Junwei Deng
6a7ab76a8e Nano: add a patch_torch/patch_tensorflow API for friendly usage (#5946)
* add a prototype code

* add patch_nano

* add pep8 changes

* add cv ppl

* fix bug

* add unpatch

* add updates

* update comment

* add changes

* add doc

* update and refactor

* update test

* fix doc

* fix according to cmt

* fix style

* fix doc

* fix bug

* fix style

* fix bug

* fix code

* add split patching api

* fix doc

* patch api to each framework

* fix pep8

* fix style

* fix style and cmt
2022-10-19 14:29:24 +08:00
Shengsheng Huang
f2e4c40cee change the readthedocs theme and reorg the sections (#6056)
* refactor toc

* refactor toc

* Change to pydata-sphinx-theme and update packages requirement list for ReadtheDocs

* Remove customized css for old theme

* Add index page to each top bar section and limit dropdown maximum to be 4

* Use js to change 'More' to 'Libraries'

* Add custom.css to conf.py for further css changes

* Add BigDL logo and search bar

* refactor toc

* refactor toc and add overview

* refactor toc and add overview

* refactor toc and add overview

* refactor get started

* add paper and video section

* add videos

* add grid columns in landing page

* add document roadmap to index

* reapply search bar and github icon commit

* reorg orca and chronos sections

* Test: weaken ads by js

* update: change left attrbute

* update: add comments

* update: change opacity to 0.7

* Remove useless theme template override for old theme

* Add sidebar releases component in the home page

* Remove sidebar search and restore top nav search button

* Add BigDL handouts

* Add back to homepage button to pages except from the home page

* Update releases contents & styles in left sidebar

* Add version badge to the top bar

* Test: weaken ads by js

* update: add comments

* remove landing page contents

* rfix chronos install

* refactor install

* refactor chronos section titles

* refactor nano index

* change chronos landing

* revise chronos landing page

* add document navigator to nano landing page

* revise install landing page

* Improve css of versions in sidebar

* Make handouts image pointing to a page in new tab

* add win guide to install

* add dliib installation

* revise title bar

* rename index files

* add index page for user guide

* add dllib and orca API

* update user guide landing page

* refactor side bar

* Remove extra style configuration of card components & make different card usage consistent

* Remove extra styles for Nano how-to guides

* Remove extra styles for Chronos how-to guides

* Remove dark mode for now

* Update index page description

* Add decision tree for choosing BigDL libraries in index page

* add dllib models api, revise core layers formats

* Change primary & info color in light mode

* Restyle card components

* Restructure Chronos landing page

* Update card style

* Update BigDL library selection decision tree

* Fix failed Chronos tutorials filter

* refactor PPML documents

* refactor and add friesian documents

* add friesian arch diagram

* update landing pages and fill key features guide index page

* Restyle link card component

* Style video frames in PPML sections

* Adjust Nano landing page

* put api docs to the last in index for convinience

* Make badge horizontal padding smaller & small changes

* Change the second letter of all header titles to be small capitalizd

* Small changes on Chronos index page

* Revise decision tree to make it smaller

* Update: try to change the position of ads.

* Bugfix: deleted nonexist file config

* Update: update ad JS/CSS/config

* Update: change ad.

* Update: delete my template and change files.

* Update: change chronos installation table color.

* Update: change table font color to --pst-color-primary-text

* Remove old contents in landing page sidebar

* Restyle badge for usage in card footer again

* Add quicklinks template on landing page sidebar

* add quick links

* Add scala logo

* move tf, pytorch out of the link

* change orca key features cards

* fix typo

* fix a mistake in wording

* Restyle badge for card footer

* Update decision tree

* Remove useless html templates

* add more api docs and update tutorials in dllib

* update chronos install using new style

* merge changes in nano doc from master

* fix quickstart links in sidebar quicklinks

* Make tables responsive

* Fix overflow in api doc

* Fix list indents problems in [User guide] section

* Further fixes to nested bullets contents in [User Guide] section

* Fix strange title in Nano 5-min doc

* Fix list indent problems in [DLlib] section

* Fix misnumbered list problems and other small fixes for [Chronos] section

* Fix list indent problems and other small fixes for [Friesian] section

* Fix list indent problem and other small fixes for [PPML] section

* Fix list indent problem for developer guide

* Fix list indent problem for [Cluster Serving] section

* fix dllib links

* Fix wrong relative link in section landing page

Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
Co-authored-by: Juntao Luo <1072087358@qq.com>
2022-10-18 15:35:31 +08:00
pinggao187
8e0d589845 update spark3.1.2 to spark3.1.3 (#6154)
* update spark3.1.2 to spark3.1.3

* uodate
2022-10-18 15:35:08 +08:00
Jiao Wang
e28edad625 [PPML] Azure PPML on graphene update (#6041)
* fix scripts and docs

* update

* add simple query to examples

* update

* update script

* update

* update

* update

* update

* update

* update
2022-10-17 18:43:23 -07:00
Guoqiong Song
8ea2907647 dllib doc fix (#6147) 2022-10-17 17:18:53 -07:00
joan726
daf86e9747 Update blogs.md (#6111) 2022-10-14 15:27:06 +08:00
binbin Deng
bde2f0930a Chronos: change import path of get_public_dataset (#6075)
* first commit

* fix
2022-10-14 09:58:38 +08:00
Hu, Zhaojie
4d56ece258 [Chronos] Add install options in chronos-nightly docker image (#6064)
* add install options for chronos dockerfile

* add invaild argument check

* add arg num check & add extra_dep arg

* remove debug message

* add build args message in README & change arg num check message

* add ml option in arg model

* add default value for each build arg

* update readme and howto guides

* fix typo

* fix typo

* fix markdown

* fix markdown
2022-10-13 22:20:28 +08:00
Shengsheng Huang
fbd5a57f93 add windows user guide (#5950)
* add windows user guide

* modifiy win user guides

* Add jupyter setup guide and known issues

* Add tips for yolov3 example

* update win guide

* update win guide

* update win guide reference

* update win guide reference

* update win guide reference

* format fix

* revise nano and chronos windows guide

* fix windows guide reference in nano install

Co-authored-by: aixideng <aixi.deng@intel.com>
2022-10-11 13:14:40 +08:00
Junwei Deng
28acefdb7c Chronos: update installation guide to reflect our work on better tensorflow support (#6066) 2022-10-10 17:31:02 +08:00
Song Jiaming
42934c9abe PPML refine keras VFL support (#6059) 2022-10-10 15:13:29 +08:00
Song Jiaming
b7be0c8c44 PPML FL document (#6017) 2022-10-08 10:22:32 +08:00
Jian Zhou
936f8d2adb update databricks doc (#6035)
Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-30 17:03:30 +08:00
Yuwen Hu
d262848421 [Document] Add API docs for bigdl.nano.tf.keras.layers.Embedding and bigdl.nano.tf.optimizers.SparseAdam (#5967)
* Add api docs for bigdl.nano.tf.keras.layers.Embedding and bigdl.nano.tf.optimizers.SparseAdam

* Update API document link in related how-to guide

* Remove non-related parameter explanation for Embedding

* Add param explanation for kwargs in for Embedding, and small revision

* Small fix
2022-09-30 13:14:42 +08:00
Ruonan Wang
f3c8ae37f1 Chronos : How to generate confidence interval for prediction (#5817)
* first commit

* fix version conflict in colab

* update based on comment

* change val_data to validation_data

* remove exit()
2022-09-28 14:34:20 +08:00
Shaojie Cui
27587b5db5 [PPML]doc: fix TPCH markdown list number render (#5992)
* Fix list number rendering wrongly

* position of the ellipsis
2022-09-28 11:07:48 +08:00
Jian Zhou
a703ae4eba Update Databricks user guide (#5920)
* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-28 09:47:18 +08:00
Yang Wang
0d696fcf92 Add tensorflow known issue for inter op parallelism cannot be modified (#5923)
* Add tensorflow known issue for inter op parallelism cannot be modified

* try clear session

* remove clear session
2022-09-27 10:45:43 -07:00
Le-Zheng
b9c73c4c20 add release link on main (#5981)
* add release link on main

* Update release.md
2022-09-27 16:58:35 +08:00
Qiyuan Gong
97b925e584 [PPML] Refine install SGX driver from Kernel document (#5978)
* Add Mellanox issue
* Add SYSTEM_REVOCATION_KEYS issue
* Fix typo
* Add libelf-dev
2022-09-27 15:55:04 +08:00
SONG Ge
79f29244d8 [Orca] Add bigdl-submit mode support (#5960)
* add bigdl-submit mode support

* modify all submit-with-bigdl

* remove submit-with-bigdl info
2022-09-27 15:17:41 +08:00
Yuwen Hu
331c3054d9 [Nano] How-To Guides: Training - TensorFlow (#5836)
* Add basic guides structure of Training - TensorFlow

* Add how-to guides: How to accelerate a TensorFlow Keras application on training workloads through multiple instances

* Change import order and add pip install for tensorflow-dataset

* Diable other nano tests for now

* Add github action tests for how-to guides Tensorflow training

* Use jupyter nbconvert to test notebooks for training tensorflow instead to avoid errors

* Add how-to guide: How to optimize your model with a sparse Embedding layer and SparseAdam optimizer

* Enable other nano tests again

* Small Revision: fix typos

* Small Revision: refactor some sentences

* Revision: refactor contents based on comments

* Add How-to guides: How to choose the number of processes for multi-instance training

* Small Revision: fix typos and refactor some sentences

* Make timeout time for github action longer for TensorFlow, 600s->700s
2022-09-26 15:40:22 +08:00
pinggao187
0cabc79133 change spark313 to spark312 (#5956) 2022-09-26 15:18:54 +08:00
Ruonan Wang
55c793c455 Nano : Update pytorch inference QuickStart with InferenceOptimizer (#5899)
* replace Trainer with InferenceOptimizer

* add warning note for deprecation of trainer.trace / trainer.quantize
2022-09-26 09:52:34 +08:00
pinggao187
0af2711dbf update pypi/spark version (#5925) 2022-09-23 14:30:49 +08:00
Qiyuan Gong
db2f80fbd8 [PPML] Refine grammar of PPML readthedoc (#5875)
* Refine grammar of secure_your_services, trusted_fl, secure_your_services, trusted_big_data_analytics_and_ml and ppml.
2022-09-21 10:37:07 +08:00
Yuwen Hu
56990ebb4a [Document] Reword "Edit on Github" Button (#5802)
* Overide sphinx_rtd_theme style to remove 'Edit on Github' button

* Change 'Edit on Github' button to 'Edit this page' for every readthedocs pages

* Add lisence for adapting sphinx_rtd_theme/breadcrumbs.html
2022-09-20 16:26:27 +08:00
Ruonan Wang
13e3137cfd Fix a bug of readthedocs about get_public_dataset (#5808) 2022-09-19 09:12:25 +08:00
Jian Zhou
5c453157de update Databricks user guide (#5779)
* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-16 10:31:55 +08:00
Jiao Wang
a1c9182515 [PPML] Fix BigDL Graphene Azure scripts (#5767)
* update

* update submit scripts
2022-09-15 18:47:38 -07:00
binbin Deng
88faa59eb4 Chronos: how to evaluate using forecaster (#5710) 2022-09-16 09:06:27 +08:00
Cengguang Zhang
de91a8ccd7 Doc: add ray port FAQ to ray overview document. (#5752)
* feat: add faq to ray overview doc.

* fix: fix doc style.

* fix: fix typo.

* feat: add ray redis and dashboard port conflict to faq.

* fix: fix redis port param name.

* fix: fix redis port param name.

* fix: fix typo

* fix: fix typo

* fix: fix wording.
2022-09-15 19:26:10 +08:00
Ruonan Wang
edcab051a9 Nano : add API for InferenceOptimizer and deprecated some Trainer APIs (#5768)
* add api and deprecated

* add license

* add deprecated

* update comment for api display

* modify comment

* update based on comment
2022-09-15 18:43:47 +08:00
Shaojie Cui
d07e862bec PPML: mod TPCH document (#5583)
* doc: modify markdown grammar typo

* doc: md typo

* typo

* fix

* fix

* fix

* hint

* correct argument

* add path of password to container

* fix syntax errors

* fix

* fix
2022-09-15 16:27:09 +08:00
binbin Deng
b9186b56ef Chronos: fix install cmd in Chronos User Guide document (#5776) 2022-09-15 15:36:50 +08:00
Yuwen Hu
12c12a1058 [Nano] How-To Guides: Training - PyTorch Lightning (#5643)
* Rearrange file structure for PyTorch Inference for docs and add titles for PyTorch-Lightning Training

* Add How-to guide: How to accelerate a PyTorch-Lightning application on training workloads through Intel® Extension for PyTorch*

* Add how-to guide: How to accelerate a PyTorch-Lightning application on training workloads through multiple instances

* Revise: remove '-' in 'PyTorch-Lightning' and some other changes

* Add How-to guides: How to use the channels last memory format in your PyTorch Lightning application for training

* Add how-to guide: Use BFloat16 Mixed Precision for PyTorch Lightning Training

* Add How-to guide: How to accelerate a computer vision data processing pipeline

* Small Revision: change comments in several code cells

* Disable other nano tests temporarily

* Add github action tests for Nano Training PyTorch Lightning tests

* Enable other nano tests again

* Small revisions: typos and explanation texts changes

* Revise: update based on comments
2022-09-15 15:26:11 +08:00
Wang Jian
528ff064f5 [PPML] Remove XGBoost from PPML guide 2022-09-15 12:03:40 +08:00
Yuwen Hu
3a19ebbfbf Add ipython extension for rendering code blocks in excuted notebooks properly in our readthedocs project (#5757) 2022-09-14 17:25:55 +08:00
ZehuaCao
732850ef3a [PPML] change KMS appkey to apikey (#5658)
* change appkey to apikey

* change APiKEY to APIKEY

Co-authored-by: Heyang Sun <60865256+Uxito-Ada@users.noreply.github.com>
2022-09-13 15:44:23 +08:00
Junwei Deng
6b337b92be Chronos: how to guide page cleaning (#5657)
* update

* add nblink

* windows guide fix

* add some updated

* update chronos

* add update image

* add new image

* add updates

* add update

* add new image

* fix typo

* fix notebook location

* add new index

* update

* fix some doc

* update tree

* fix typo
2022-09-11 17:51:13 +08:00
David smurf
c73fc9f6ad Chronos: train tcn model on gpu and speed up inference on cpu (#5594)
* add nano_gpu

* simplify the code

* simplify the code

* modify the code

* add some updates

* add document

Co-authored-by: theaperdeng <theaperdeng@outlook.com>
2022-09-09 13:07:22 +08:00
Kai Huang
dcff01690b Add Ray arguments in init_orca_context to Doc page (#5686)
* add ray docs

* fix

* fix

* fix style

* minor
2022-09-08 18:18:18 +08:00
binbin Deng
103546d8fe Chronos: how to speedup inference on one node (onnx, openvino) (#5556)
* how to speedup inference on one node

* index added

* fixed

* fixed

* split to 2 guides

* add build_onnx and build_openvino

* add note border

* fix

* fix colab conflict

Co-authored-by: binbin <binbin1.deng@intel.com>
2022-09-07 17:53:38 +08:00
liangs6212
46b0fda3ca Chronos: how to create a forecaster (#5172)
* how to guide from_tsdataset

* improve md

* remove redundant message

* fix known issues

* add rst

* move create-forecaster to new line

* fix known issue

* fix syntax error

* fix syntax error again

* add open-colab icon

* fix known issues

* fix some words

* fix typo

* fix syntax error

* add some update

Co-authored-by: theaperdeng <theaperdeng@outlook.com>
2022-09-07 14:44:06 +08:00
Yishuo Wang
62b8aa8703 fix nano UT (#5650) 2022-09-06 17:09:31 +08:00
binbin Deng
01ec6107f8 Chronos: make roll=True the default value for to_torch_data_loader (#5605) 2022-09-06 09:28:03 +08:00
Ruonan Wang
2f1f3ba114 Chronos : Penalize underestimation example (#5627)
* add example

* remove valid dataset

* fix typo

* modify parameters and graph

* update based on comment

* modify index link

* modify js

* update
2022-09-02 15:46:12 +08:00
Yuwen Hu
30dd0bd6c2 [Nano] Nano How-to Guides: Format & PyTorch Inference (#5480)
* Create doc tree index for Nano How-to Guides

* Add How to guide for PyTorch Inference using ONNXRuntime

* Add How to guide for PyTorch Inference using OpenVINO

* Update How to guide for PyTorch Inference using OpenVINO/ONNXRuntime

* Change current notebook to md and revise contents to be more concentrated

* Add How-to Guide: Install BigDL-Nano in Google Colab (need further update)

* Revise words in How-to Guide for PyTorch Inference using OpenVINO/ONNXRuntime

* Add How-To Guide: Quantize PyTorch Model for Inference using Intel Neural Compressor

* Add How-To Guide: Quantize PyTorch Model for Inference using Post-training Quantization Tools

* Add API doc links and small revision

* Test: syncronization through marks in py files

* Test: syncronization through notebook with cells hidden from rendering in doc

* Remove test commits for runnable example <-> guides synchronization

* Enable rendering notebook from location out of sphinx source root

* Update guide "How to accelerate a PyTorch inference pipeline through OpenVINO" to notebook under python folder

* Update guide "How to quantize your PyTorch model for inference using Intel Neural Compressor" to notebook under python folder

* Fix bug that markdown will be ignored inside html tags for nbconvert, and notebook revise

* Update guide 'How to quantize your PyTorch model for inference using Post-training Optimization Tools' to notebook under python folder

* Small updates to index and current guides

* Revision based on Junwei's comments

* Update how-to guides: How to install BigDL-Nano in Google Colab, and update index page

* Small typo fix
2022-09-02 10:17:06 +08:00
Cengguang Zhang
f8f717a684 Doc: update hadoop document. (#5623)
* doc: update hadoop document.

* fix: fix wording.

* fix: fix wording.

* fix: fix wording.
2022-09-02 08:05:43 +08:00
Juntao_Luo
0f1cfd82ff Chronos: installation panel enhancement (#5588)
* Update:installation panel enhancement
Left a bug to fix and install CMD to revise.

* Bugfix: Fixed a bug when using Firefox browser to use the install guide form.
Fixed the bug that the table's background color may be changed by mistake on Firefox browser.

* Update: update panel as comment required.

* Bugfix: fixed a bug in js file that will show wrong cmd when clicking 'windows' or 'docker'.

* Bugfix: fixed the bug that 'cmd' shows incorrectly when clicking 'prophet' and 'ARIMA'.
2022-09-01 21:11:59 +08:00
Yuwen Hu
57e46c6160 [Documentation] Add Extension nbsphinx-link (#5596)
* Add extension nbsphinx-link: link notebook out of the sphinx root folder to the sphinx project

* Link Notebook custom.ipynb directly from python folder to the sphinx project

* Link Notebook seq_and_func.ipynb directly from python folder to the sphinx project

* Small title fix

* Make interactive graphs visible in readthedocs webpage for seq_and_func.ipynb

* Regenerate outputs for custom.ipynb and remove parts of them
2022-09-01 11:54:24 +08:00
Jason Dai
9e76c7e16e Update powered-by.md 2022-08-31 21:20:56 +08:00
Jason Dai
692f79a1c7 Update powered-by.md 2022-08-31 20:57:42 +08:00
Ruonan Wang
3df26cc9ed Chronos : add [how to tune a forecaster model] notebook (#5399)
* add how_to_tune_a_forecaster_model notebook

* modify step1: data preparation

* update based how to train

* modify a bug of summary

* update based on comment

* move to howto

* fix typo

* add file

* update based on comments

* rename the tile
2022-08-30 22:24:49 +08:00
Cengguang Zhang
57d45e5deb Orca: add save and load model doc to PyTorch Estimator quick-start. (#5504)
* feat: add save and load model doc to pytorch estimator quickstart.

* fix: fix typo.

* fix: fix typo

* fix: fix typo.

* feat: add doc to ray backend quickstart

* fix: fix typo.

* feat: add doc to ray backend quickstart
2022-08-24 13:48:32 +08:00
Juntao_Luo
584ee6045c Chronos: update js, css and md files to add filter function in tutorial page. (#5506) 2022-08-23 12:50:29 +08:00
Cengguang Zhang
c94e934068 Orca: update known-issues. (#5505)
* fix: update known-issues.

* fix: fix wording.
2022-08-23 11:21:37 +08:00
Yuwen Hu
cc540d0c34 Update "Open in Colab" button in notebooks (#5452)
* Update open in colab button from HTML-style hyperlinks to markdown image with link for notebooks in readthedocs folder

* Update "Open in Colab" button for notebooks under python folder with markdown image with link
2022-08-18 14:55:20 +08:00
Yishuo Wang
e62b8d1fc5 Automatically unwrap attributes access of _LiteModule (#5392)
* automatically unwrap attributes access of _LiteModule and add test for it
* delete redundant documents
2022-08-18 10:57:52 +08:00
Qiyuan Gong
df75c72d91 Add Key generation suggestion into document (#5446)
* Add SSL and AES Key generation suggestion into document.
2022-08-17 22:55:53 +08:00
Chaselzxy
b11496db60 Chronos: How-to-Guides (How to train forecaster on single node) (#5224)
* how to train forecaster

* add a notebook

* add new notebook

* add index

* fix colab link

* change content

Co-authored-by: Xinyi Zhang <xinyi1.zhang@intel.com>
Co-authored-by: theaperdeng <theaperdeng@outlook.com>
2022-08-17 20:11:24 +08:00
Cengguang Zhang
241b0f1712 Docs: fix typo and quickstart code branch. (#5414) 2022-08-16 16:20:46 +08:00
Cengguang Zhang
6af23499e7 Docs: add save and load model docs. (#5397)
* docs: add save and load model docs.

* fix: update code style.

* fix: update code style.

* fix: fix typo and modify wording.

* docs: add save model example to notebook.

* fix: fix typo.
2022-08-16 15:23:30 +08:00
shaojie
611c9aefdf fix Notebook issues (#5344)
* fix Notebook issues

* update start-notebook scripts to add token and port parameter.

* update start notebook scripts

* test start notebook scripts and deployment yaml file

* update image tag to latest

* update deployment file,README and start-notebook script file

* update README

* update README

Co-authored-by: baishaojie <shaojiex.bai@intel.com>
2022-08-16 10:39:39 +08:00
Jason Dai
bdce772965 Update powered-by.md 2022-08-16 07:12:36 +08:00
Cengguang Zhang
2c0424e964 Docs: update orca known issues (#5395)
* docs: update known issues

* fix: add example to known issue

* fix: add example to known issue

* fix: fix typo

* fix: modify issue description.

* fix: fix typo.

* fix: fix typo.
2022-08-15 18:20:45 +08:00
Jiao Wang
a440a05b0c Azure PPML doc update (#5386)
* update

* update
2022-08-12 15:44:33 -07:00
Song Jiaming
362674ee1c Add a ssl/tls section of Secure Your Devices README (#5366)
* Add a ssl/tls section of Secure Your Devices README
2022-08-12 10:07:16 +08:00
Juntao_Luo
dfb0946075 Chronos: Update Chronos install guide form's js and css file. (#5360)
* Update chronos_installation_guide.css

* Update chronos_installation_guide.js

* Update chronos.md

* Change border color

* Deleted test text in '2. Install' title

I changed the title in last commit to check if my build in readthedoc web works fine. Now I delete it.

* Update button css selector

Revised the button selector to avoid influencing other buttons' style on the web.

* Update #cmd height

* Update as pull-request comment required.

1, disable other options when users choose windows, and guide users to https://bigdl.readthedocs.io/en/latest/doc/Chronos/Overview/windows_guide.html in "Install CMD"
2, guide users to https://bigdl.readthedocs.io/en/latest/doc/Chronos/Overview/chronos.html#tensorflow-backend in "Install CMD" when tensorflow is chosen.
3, guide users to https://github.com/intel-analytics/BigDL/tree/main/docker/chronos-nightly in "install CMD" when docker is chosen.

* Update css file to meet the comment requirements

Make the disabled items' background darker to have a better vis experience. 
Have a larger fontsize.

* Update js file to meet the comment requirement.

 Make the disabled items' background darker to have a better vis experience.

* Update border css settings.

Changed table border settings since last version looks not good.

* Change pmdarima to ARIMA

* Update visuals.

The button now has a hovering style, indicating the user that it can be clicked.
2022-08-11 17:30:03 +08:00
Jiao Wang
c8dd8d6e5e update (#5362) 2022-08-10 12:56:41 -07:00
Yishuo Wang
19e6099483 supplement the doc of torchnano (#5348) 2022-08-10 09:54:56 +08:00
Junwei Deng
b2dac661db Chronos: add quick tour page (#5217)
* add quick tour

* update some md

* update quick tour

* add some contents

* add some changes

* change link

* add new file

* fix some typo

* fix typo

* fix typo

* fix typo

* fix typo

* fix typos

* fix bug

* fix typos

* fix typos

* fix bug

* fix bug

* fix bug

* fix bug

* add information

* fix type

* add description

* add more content

* add some bug fix

* update document

* update

* update page

* fix typo

* update typos

* fix typo
2022-08-09 12:16:38 +08:00
David smurf
99bef5579d Chronos: XShardsTSDataset user guide (will be reused in how-to handle large data) (#5196)
* new xshards_doc

* update

* update

* update

* update

* update

* update

* update

* udpate xshardstsdataset doc

* fix typos

* fix some typos

Co-authored-by: theaperdeng <theaperdeng@outlook.com>
2022-08-09 09:53:00 +08:00
Mingzhi Hu
5506f60732 Nano: Add TensorFlow step by step tutorials (#5156)
* Add tutorial notebook

* Add md

* Test on readthedocs

* Fix markdown

* fix md

* update notebooks

* update requirements version in doc

* update

* add and update tutorial

* add unit test for tensorflow tutorial

* reduce test time

* reduce test time

* update shell

* update action

* Update tutorial

* reduce ut time

* reduce ut time

* reduce ut time

* reduce ut time

* reduce ut time

* Update

* Fix shell

* update

* update

* rollback requirements

* Update

* Update

Co-authored-by: pinggao187 <ping.gao3@pactera.com>
2022-08-09 09:03:45 +08:00
Cengguang Zhang
985aec4425 Orca: add grpc error to orca known issues (#5309)
* feat: add grpc error to orca known issues

* refactor: update short name and style.

* refactor: refine error explanation

* Update known_issues.md

* Update known_issues.md
2022-08-08 18:10:29 +08:00
Ziyao Peng
41f602fcec Chronos: Add a page 'Windows User Guide.md' to ReadTheDocs (#5263)
* Add files via upload

* Update _toc.yml

* Update windows_guide.md

* r

* Delete windows_guide.html
2022-08-08 17:41:29 +08:00
Ruonan Wang
f682f79166 Chronos : add multi-objective HPO with latency tutorial (#5307)
* add mo hpo with latency tutorial

* update according to comment

* remove test_data

* add license
2022-08-08 14:28:29 +08:00
Junwei Deng
9dbe743ea4 Chronos: add more installation options (#5175)
* add installation options

* add new tested setup.py and quickstart changes

* add installation guide

* add some doc fix

* chronos typo

* fix typos

* fix pep8

* fix accord comments
2022-08-05 14:11:48 +08:00
Yuwen Hu
7ef605b58f [Nano] Correct typos in ReadtheDocs (#5250)
* Correct typos for Nano User Guide page

* Correct typos for BigDL-Nano PyTorch Training Overview page

* Correct typos for BigDL-Nano PyTorch Inference Overview page

* Correct typos for BigDL-Nano PyTorch ONNXRuntime Acceleration Quickstart page

* Correct typos for Windows User Guide page

* Correct typos for BigDL-Nano TensorFlow Training Overview page

* Correct typos for BigDL-Nano TensorFlow Inference Overview page

* Small fix based on Shengsheng's comments

* Fix based on Wang, Yang's comments
2022-08-03 10:37:08 +08:00
Kai Huang
70b2070e4d Update Python User Guide (#5275)
* add doc

* fix
2022-08-02 12:24:52 +08:00
Yishuo Wang
0f78a568c7 add tutorial, notebook and API doc for LightningLite (#5114)
* add tutorial, notebook and API doc for LightningLite
* increase the timeout when running tutorial notebook
* change docs and tutorial to use new API
2022-08-02 09:15:50 +08:00
Kai Huang
cda8967416 Fix libhdfs known issue doc (#5257)
* fix doc

* minor
2022-08-01 20:28:36 +08:00
joan726
df2a7dcef0 Update powered-by.md (#5261) 2022-08-01 15:03:48 +08:00
Yuwen Hu
a4bbadeb61 [Nano] Integrate ipynb files into ReadtheDocs (#5222)
* Add nbsphinx extension for docs

* Add specific ipynb files to readthedocs folder and add links to Nano Tutorials index page

* Disable execution of ipynb notebook

* Remove outputs of two ipynb files

* Rename titles and add navigation texts to seq_and_func.ipynb under readthedocs folder

* Rename titles and add navigation texts to custom.ipynb file under readthedocs folder
2022-08-01 13:06:03 +08:00
Cengguang Zhang
50c180520e Docs: Bigdl known issues docs (#5204)
* docs: add dynamic allocation to FAQ/known issues in docs

* style: reformat the code

* docs: add known_issues to _toc.yml

* docs: remove known-issues.md

* fix: delete unnecessary issues

* fix: refine known_issue format and add barrier mode configuration.

* fix: reformat known_issues.md

* fix: update known_issues.md

* fix: modify known_issues.md

* fix: amend the wording
2022-07-28 16:18:18 +08:00
Shengsheng Huang
928b016d88 rollback tensorflow 1.15 dependency (#5232) 2022-07-28 11:25:43 +08:00
Shengsheng Huang
e4ca63a97f [doc] move current toc out of readthedocs landingpage (#5201)
* remove toc from landing page

* update extension version

* resolve version conflict

* remove toc in page

* fix toc

* fix toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc
2022-07-26 13:17:42 +08:00
Jiao Wang
f5909aee9f Update Azure PPML docs (#5163)
* update doc

* update

* update

* update
2022-07-25 12:59:34 -07:00
Zhao Changmin
d120db025e Mirgate Terminal Setup Steps into Developer Guide (#5133)
* correct prepare_env.sh path

* Alternative way to prepare envs
2022-07-25 15:35:00 +08:00
pinggao187
00a6a2a22f Readthedoc: update requirements version in doc (#5181)
* update requirements version in doc

* update
2022-07-25 10:09:18 +08:00
Yuwen Hu
a44571f8a3 Chronos: Correct typo for Chronos User Guide (#5166) 2022-07-22 14:49:43 +08:00
Junwei Deng
8f177b90b7 Readthedoc: fix markdown version in doc (#5164)
* fix markdown version

* fix md version
2022-07-22 10:43:28 +08:00
obarut
7232f23176 Chronos: installation user guide typo (#4915)
* avoid installation of python 3.7.0 and typo

python 3.7.0 and 3.7.1 is problematic with Ray (happens while orca context being init.)

* go back to py 3.7

if base conda env is not py 3.7.0 or 3.7.1, then no pb.
2022-07-12 19:57:30 +08:00
plusbang
fa3c7f8aff chronos: user guide python version note change (#5067)
Co-authored-by: binbin <binbin1.deng@intel.com>
2022-07-11 17:10:19 +08:00
Shaojun Liu
98f1b7a406 [ppml] add ppml cli into docker image (#5056)
* add bigdl-ppml-submit.sh into ppml graphene image

* remove ppml-spark-submit.sh since it was replaced by bigdl-ppml-submit.sh

* update ppml-spark-submit.sh to bigdl-ppml-submit.sh
2022-07-08 17:09:47 +08:00
Yang Wang
01e6c62a68 Fix typo in nano documentation (#5036) 2022-07-07 09:43:10 +08:00
Mingzhi Hu
2157af9a03 Add rst (#5027) 2022-07-06 14:21:11 +08:00
Junwei Deng
d904070154 Chronos: fix some api document tag (#5017) 2022-07-05 10:41:11 +08:00
Shane Huang
16005ada17 add hpo tutorial (#5011) 2022-07-04 17:23:33 +08:00
Shane Huang
53ba2d8279 fix docs (#5009)
* fix docs

* add resources
2022-07-04 16:59:10 +08:00
Shane Huang
3f576e5ffa Nano docs: add hpo api docs (#4901)
fix hpo api docs
2022-07-04 14:37:13 +08:00
Qiyuan Gong
501505af0d [PPML] Fix typo in link (#5005)
* trusted_big_bata_analytics_and_ml.md -> trusted_big_data_analytics_and_ml.md
2022-07-04 13:02:09 +08:00
Qiyuan Gong
df6dfc6a22 Application security doc (#5001)
* Data lifecycle
* HDFS Security
* Spark Security
* K8S Security
2022-07-04 11:16:29 +08:00
Mingzhi Hu
798345123f Nano: Update Nano PyTorch quick start doc (#4897)
* add BigDL-Nano PyTorch Quickstart

* Update BigDL-Nano PyTorch Quickstart

* Update BigDL-Nano PyTorch Quickstart

* Add Nano inference quickstart
- add inference onnx quickstart
- add inference openvino quickstart
- add quantization inc quickstart
- add quantization inc onnx quickstart
- add quantization openvino quickstart

* update quickstart

* update quickstart

* Add Nano quantization quickstart

* update nano docs

* Update docs

* Update Nano OpenVINO tutorial

* Update

* Update index.md

* Resize Images

* Resize Images

* Update

* Update Nano docs

* Update nano documents

* Update doc & notebook

* clear output of cells

* add unit tests for tutorial notebooks

* fix errors in yaml

* fix error in notebook

* reduce quantization time

* Update yaml

* Add unit test for tutorial

* Add tests for tutorial

* fix shell
2022-07-04 10:10:21 +08:00
Shane Huang
a6cab83afd revise Chronos api doc (#4993) 2022-07-01 18:19:46 +08:00
Shane Huang
b53074af53 fix docs (#4992) 2022-07-01 12:14:43 +08:00
Shane Huang
41a28c317f update visualization docs (#4980)
* update docs
2022-06-30 23:08:12 +08:00
Le-Zheng
cef5359c54 update tpch doc (#4979) 2022-06-30 12:59:31 +08:00
Junwei Deng
26ec59edf7 Chronos: add autoformer example on electricity and api doc (#4950)
* add autoformer example and api doc

* update license and readme
2022-06-28 17:37:20 +08:00
Jason Dai
b23f66ebbc Update Readme (#4957)
* Update README.md

* Update index.rst

* Update README.md
2022-06-28 09:27:40 +08:00
Song Jiaming
18a9c2f57a PPML FGBoost tutorial draft (#4751) 2022-06-27 15:46:52 +08:00
David smurf
500b7bbe99 Chronos: add tf forecaster doc (#4923) 2022-06-27 11:33:41 +08:00
Junwei Deng
76608a5034 Orca: add dashboard.log error in known issue (#4943)
* add dashboard.log error

* add title

* typo fix
2022-06-27 11:10:24 +08:00
Shan Yu
86fa1c02ab Rename Orca Tensorflow Estimator backend name from "tf2" to "ray" (#4938)
* rename backend name from tf2 to ray

* rename in doc

* rename in docstring

* manually

* rename test_tf2estimator_tf2_backend.py -> test_tf2estimator_ray_backend.py

* change tf2 in multi_agent_two_trainers.py back
2022-06-27 08:40:33 +08:00
Shan Yu
8f51ed4cf1 Add Orca Known issues (#4940) 2022-06-24 16:45:41 +08:00
Mingzhi Hu
145216bfc1 Update pytorch to 1.11 (#4854)
* update setup and action

* fix yml

* update yml

* test yml

* update docs

* update notebook requirements

* test notebooks unit test

* reset yml

* delete comments

* fix yml

* fix errors in setup.py

* fix setup.py

* specify the version of IPEX
2022-06-24 16:38:48 +08:00
Rebekk
8e10bdeabd Chronos: add Evaluator doc (#4889)
* add evaluator doc

* add index
2022-06-21 09:47:25 +08:00
Zhentao Chen
7dcd79366f doc fix (#4829) 2022-06-15 08:23:01 +08:00
Nancy
04542bc6db Fix code style in PyTorch QuickStart (#4821)
* fix two issues

* fix two issues
2022-06-14 09:58:43 +08:00
Zhentao Chen
e7c7ab2b8e [Nano] add tf inference doc (#4797)
* add tf inference doc

* fix doc

* grammarly check

* add sequential
2022-06-13 08:54:48 +08:00
jenniew
f687e4b684 Update Azure PPML doc (#4809)
* add script

* update

* update

* update scripts and doc

* update pass

* update

* update docker

* update

* aks script

* update create aks

* add doc

* update

* vm size note
2022-06-12 17:22:43 -07:00
jenniew
6aeabae58b Azure PPML support (#4660)
* add script

* update

* update

* update scripts and doc

* update pass

* update

* update docker

* update

* aks script

* update create aks

* add doc

* update
2022-06-12 17:06:24 -07:00
Jason Dai
c8a07474ee Update index.rst 2022-06-10 21:50:04 +08:00
Mingzhi Hu
2c4623f8da Update pytorch_train.md (#4786)
* Update pytorch_train.md

Add description about torchvision version

* Update pytorch_train.md
2022-06-09 08:39:44 +08:00
Yang Wang
20ad708010 Add Nano PyTorch API Doc (#4730)
* add trainer api doc

* add index and fix trainer

* fix doc

* reset

* fix conflict

* fix import
2022-06-08 17:45:24 +08:00
jenniew
e150593602 Azure PPML documentation (#4675)
* az doc

* update

* update
2022-06-07 08:20:24 -07:00
Zhentao Chen
900711f1b3 [Nano] add pytorch inference doc (#4656)
* pytorch inference doc init commit

* quantization with tuning

* fix grammarly

* remove val_dataloader

* specify version
2022-06-02 14:42:00 +08:00
Shane Huang
8ced71c488 revise hpo doc (#4735) 2022-05-31 17:35:52 +08:00
Shane Huang
e24859c39b add resume and parallel search docs (#4734) 2022-05-31 17:08:23 +08:00
liangs6212
0af87a18c6 Chronos: Fix readthedocs.io build error (#4720)
* add pickle5 version

* fix doc issue

* fix import bigdl.nano in doc

* renamed basepytorchmodel to baseautomodel

* renamed again
2022-05-30 17:52:20 +08:00
Shan Yu
5bc293b9c5 Update Chronos installation guide (#4698) 2022-05-26 10:20:33 +08:00
Le-Zheng
db2818c8f7 update databrciks doc (#4691) 2022-05-26 07:41:44 +08:00
Yang Wang
55fa3e13e6 Add Nano Known issues and some notebook link (#4667)
* Add Nano Known issues and some notebook link

* fix typo
2022-05-25 10:26:46 +08:00
Shane Huang
353e7ffbdf [Nano HPO] revised user guide (#4666)
* revise doc

* revise doc

* revise docs again
2022-05-24 14:42:42 +08:00
Shane Huang
993c80b427 [Nano HPO] user guide (#4639)
* add initial version of hpo doc

* modify the doc index

* revised doc

* revise docs

* revise docs
2022-05-23 21:33:27 +08:00