Commit graph

267 commits

Author SHA1 Message Date
pinggao187
8e0d589845 update spark3.1.2 to spark3.1.3 (#6154)
* update spark3.1.2 to spark3.1.3

* uodate
2022-10-18 15:35:08 +08:00
Jiao Wang
e28edad625 [PPML] Azure PPML on graphene update (#6041)
* fix scripts and docs

* update

* add simple query to examples

* update

* update script

* update

* update

* update

* update

* update

* update
2022-10-17 18:43:23 -07:00
Guoqiong Song
8ea2907647 dllib doc fix (#6147) 2022-10-17 17:18:53 -07:00
joan726
daf86e9747 Update blogs.md (#6111) 2022-10-14 15:27:06 +08:00
binbin Deng
bde2f0930a Chronos: change import path of get_public_dataset (#6075)
* first commit

* fix
2022-10-14 09:58:38 +08:00
Hu, Zhaojie
4d56ece258 [Chronos] Add install options in chronos-nightly docker image (#6064)
* add install options for chronos dockerfile

* add invaild argument check

* add arg num check & add extra_dep arg

* remove debug message

* add build args message in README & change arg num check message

* add ml option in arg model

* add default value for each build arg

* update readme and howto guides

* fix typo

* fix typo

* fix markdown

* fix markdown
2022-10-13 22:20:28 +08:00
Shengsheng Huang
fbd5a57f93 add windows user guide (#5950)
* add windows user guide

* modifiy win user guides

* Add jupyter setup guide and known issues

* Add tips for yolov3 example

* update win guide

* update win guide

* update win guide reference

* update win guide reference

* update win guide reference

* format fix

* revise nano and chronos windows guide

* fix windows guide reference in nano install

Co-authored-by: aixideng <aixi.deng@intel.com>
2022-10-11 13:14:40 +08:00
Junwei Deng
28acefdb7c Chronos: update installation guide to reflect our work on better tensorflow support (#6066) 2022-10-10 17:31:02 +08:00
Song Jiaming
42934c9abe PPML refine keras VFL support (#6059) 2022-10-10 15:13:29 +08:00
Song Jiaming
b7be0c8c44 PPML FL document (#6017) 2022-10-08 10:22:32 +08:00
Jian Zhou
936f8d2adb update databricks doc (#6035)
Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-30 17:03:30 +08:00
Yuwen Hu
d262848421 [Document] Add API docs for bigdl.nano.tf.keras.layers.Embedding and bigdl.nano.tf.optimizers.SparseAdam (#5967)
* Add api docs for bigdl.nano.tf.keras.layers.Embedding and bigdl.nano.tf.optimizers.SparseAdam

* Update API document link in related how-to guide

* Remove non-related parameter explanation for Embedding

* Add param explanation for kwargs in for Embedding, and small revision

* Small fix
2022-09-30 13:14:42 +08:00
Ruonan Wang
f3c8ae37f1 Chronos : How to generate confidence interval for prediction (#5817)
* first commit

* fix version conflict in colab

* update based on comment

* change val_data to validation_data

* remove exit()
2022-09-28 14:34:20 +08:00
Shaojie Cui
27587b5db5 [PPML]doc: fix TPCH markdown list number render (#5992)
* Fix list number rendering wrongly

* position of the ellipsis
2022-09-28 11:07:48 +08:00
Jian Zhou
a703ae4eba Update Databricks user guide (#5920)
* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-28 09:47:18 +08:00
Yang Wang
0d696fcf92 Add tensorflow known issue for inter op parallelism cannot be modified (#5923)
* Add tensorflow known issue for inter op parallelism cannot be modified

* try clear session

* remove clear session
2022-09-27 10:45:43 -07:00
Le-Zheng
b9c73c4c20 add release link on main (#5981)
* add release link on main

* Update release.md
2022-09-27 16:58:35 +08:00
Qiyuan Gong
97b925e584 [PPML] Refine install SGX driver from Kernel document (#5978)
* Add Mellanox issue
* Add SYSTEM_REVOCATION_KEYS issue
* Fix typo
* Add libelf-dev
2022-09-27 15:55:04 +08:00
SONG Ge
79f29244d8 [Orca] Add bigdl-submit mode support (#5960)
* add bigdl-submit mode support

* modify all submit-with-bigdl

* remove submit-with-bigdl info
2022-09-27 15:17:41 +08:00
Yuwen Hu
331c3054d9 [Nano] How-To Guides: Training - TensorFlow (#5836)
* Add basic guides structure of Training - TensorFlow

* Add how-to guides: How to accelerate a TensorFlow Keras application on training workloads through multiple instances

* Change import order and add pip install for tensorflow-dataset

* Diable other nano tests for now

* Add github action tests for how-to guides Tensorflow training

* Use jupyter nbconvert to test notebooks for training tensorflow instead to avoid errors

* Add how-to guide: How to optimize your model with a sparse Embedding layer and SparseAdam optimizer

* Enable other nano tests again

* Small Revision: fix typos

* Small Revision: refactor some sentences

* Revision: refactor contents based on comments

* Add How-to guides: How to choose the number of processes for multi-instance training

* Small Revision: fix typos and refactor some sentences

* Make timeout time for github action longer for TensorFlow, 600s->700s
2022-09-26 15:40:22 +08:00
pinggao187
0cabc79133 change spark313 to spark312 (#5956) 2022-09-26 15:18:54 +08:00
Ruonan Wang
55c793c455 Nano : Update pytorch inference QuickStart with InferenceOptimizer (#5899)
* replace Trainer with InferenceOptimizer

* add warning note for deprecation of trainer.trace / trainer.quantize
2022-09-26 09:52:34 +08:00
pinggao187
0af2711dbf update pypi/spark version (#5925) 2022-09-23 14:30:49 +08:00
Qiyuan Gong
db2f80fbd8 [PPML] Refine grammar of PPML readthedoc (#5875)
* Refine grammar of secure_your_services, trusted_fl, secure_your_services, trusted_big_data_analytics_and_ml and ppml.
2022-09-21 10:37:07 +08:00
Yuwen Hu
56990ebb4a [Document] Reword "Edit on Github" Button (#5802)
* Overide sphinx_rtd_theme style to remove 'Edit on Github' button

* Change 'Edit on Github' button to 'Edit this page' for every readthedocs pages

* Add lisence for adapting sphinx_rtd_theme/breadcrumbs.html
2022-09-20 16:26:27 +08:00
Ruonan Wang
13e3137cfd Fix a bug of readthedocs about get_public_dataset (#5808) 2022-09-19 09:12:25 +08:00
Jian Zhou
5c453157de update Databricks user guide (#5779)
* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-16 10:31:55 +08:00
Jiao Wang
a1c9182515 [PPML] Fix BigDL Graphene Azure scripts (#5767)
* update

* update submit scripts
2022-09-15 18:47:38 -07:00
binbin Deng
88faa59eb4 Chronos: how to evaluate using forecaster (#5710) 2022-09-16 09:06:27 +08:00
Cengguang Zhang
de91a8ccd7 Doc: add ray port FAQ to ray overview document. (#5752)
* feat: add faq to ray overview doc.

* fix: fix doc style.

* fix: fix typo.

* feat: add ray redis and dashboard port conflict to faq.

* fix: fix redis port param name.

* fix: fix redis port param name.

* fix: fix typo

* fix: fix typo

* fix: fix wording.
2022-09-15 19:26:10 +08:00
Ruonan Wang
edcab051a9 Nano : add API for InferenceOptimizer and deprecated some Trainer APIs (#5768)
* add api and deprecated

* add license

* add deprecated

* update comment for api display

* modify comment

* update based on comment
2022-09-15 18:43:47 +08:00
Shaojie Cui
d07e862bec PPML: mod TPCH document (#5583)
* doc: modify markdown grammar typo

* doc: md typo

* typo

* fix

* fix

* fix

* hint

* correct argument

* add path of password to container

* fix syntax errors

* fix

* fix
2022-09-15 16:27:09 +08:00
binbin Deng
b9186b56ef Chronos: fix install cmd in Chronos User Guide document (#5776) 2022-09-15 15:36:50 +08:00
Yuwen Hu
12c12a1058 [Nano] How-To Guides: Training - PyTorch Lightning (#5643)
* Rearrange file structure for PyTorch Inference for docs and add titles for PyTorch-Lightning Training

* Add How-to guide: How to accelerate a PyTorch-Lightning application on training workloads through Intel® Extension for PyTorch*

* Add how-to guide: How to accelerate a PyTorch-Lightning application on training workloads through multiple instances

* Revise: remove '-' in 'PyTorch-Lightning' and some other changes

* Add How-to guides: How to use the channels last memory format in your PyTorch Lightning application for training

* Add how-to guide: Use BFloat16 Mixed Precision for PyTorch Lightning Training

* Add How-to guide: How to accelerate a computer vision data processing pipeline

* Small Revision: change comments in several code cells

* Disable other nano tests temporarily

* Add github action tests for Nano Training PyTorch Lightning tests

* Enable other nano tests again

* Small revisions: typos and explanation texts changes

* Revise: update based on comments
2022-09-15 15:26:11 +08:00
Wang Jian
528ff064f5 [PPML] Remove XGBoost from PPML guide 2022-09-15 12:03:40 +08:00
Yuwen Hu
3a19ebbfbf Add ipython extension for rendering code blocks in excuted notebooks properly in our readthedocs project (#5757) 2022-09-14 17:25:55 +08:00
ZehuaCao
732850ef3a [PPML] change KMS appkey to apikey (#5658)
* change appkey to apikey

* change APiKEY to APIKEY

Co-authored-by: Heyang Sun <60865256+Uxito-Ada@users.noreply.github.com>
2022-09-13 15:44:23 +08:00
Junwei Deng
6b337b92be Chronos: how to guide page cleaning (#5657)
* update

* add nblink

* windows guide fix

* add some updated

* update chronos

* add update image

* add new image

* add updates

* add update

* add new image

* fix typo

* fix notebook location

* add new index

* update

* fix some doc

* update tree

* fix typo
2022-09-11 17:51:13 +08:00
David smurf
c73fc9f6ad Chronos: train tcn model on gpu and speed up inference on cpu (#5594)
* add nano_gpu

* simplify the code

* simplify the code

* modify the code

* add some updates

* add document

Co-authored-by: theaperdeng <theaperdeng@outlook.com>
2022-09-09 13:07:22 +08:00
Kai Huang
dcff01690b Add Ray arguments in init_orca_context to Doc page (#5686)
* add ray docs

* fix

* fix

* fix style

* minor
2022-09-08 18:18:18 +08:00
binbin Deng
103546d8fe Chronos: how to speedup inference on one node (onnx, openvino) (#5556)
* how to speedup inference on one node

* index added

* fixed

* fixed

* split to 2 guides

* add build_onnx and build_openvino

* add note border

* fix

* fix colab conflict

Co-authored-by: binbin <binbin1.deng@intel.com>
2022-09-07 17:53:38 +08:00
liangs6212
46b0fda3ca Chronos: how to create a forecaster (#5172)
* how to guide from_tsdataset

* improve md

* remove redundant message

* fix known issues

* add rst

* move create-forecaster to new line

* fix known issue

* fix syntax error

* fix syntax error again

* add open-colab icon

* fix known issues

* fix some words

* fix typo

* fix syntax error

* add some update

Co-authored-by: theaperdeng <theaperdeng@outlook.com>
2022-09-07 14:44:06 +08:00
Yishuo Wang
62b8aa8703 fix nano UT (#5650) 2022-09-06 17:09:31 +08:00
binbin Deng
01ec6107f8 Chronos: make roll=True the default value for to_torch_data_loader (#5605) 2022-09-06 09:28:03 +08:00
Ruonan Wang
2f1f3ba114 Chronos : Penalize underestimation example (#5627)
* add example

* remove valid dataset

* fix typo

* modify parameters and graph

* update based on comment

* modify index link

* modify js

* update
2022-09-02 15:46:12 +08:00
Yuwen Hu
30dd0bd6c2 [Nano] Nano How-to Guides: Format & PyTorch Inference (#5480)
* Create doc tree index for Nano How-to Guides

* Add How to guide for PyTorch Inference using ONNXRuntime

* Add How to guide for PyTorch Inference using OpenVINO

* Update How to guide for PyTorch Inference using OpenVINO/ONNXRuntime

* Change current notebook to md and revise contents to be more concentrated

* Add How-to Guide: Install BigDL-Nano in Google Colab (need further update)

* Revise words in How-to Guide for PyTorch Inference using OpenVINO/ONNXRuntime

* Add How-To Guide: Quantize PyTorch Model for Inference using Intel Neural Compressor

* Add How-To Guide: Quantize PyTorch Model for Inference using Post-training Quantization Tools

* Add API doc links and small revision

* Test: syncronization through marks in py files

* Test: syncronization through notebook with cells hidden from rendering in doc

* Remove test commits for runnable example <-> guides synchronization

* Enable rendering notebook from location out of sphinx source root

* Update guide "How to accelerate a PyTorch inference pipeline through OpenVINO" to notebook under python folder

* Update guide "How to quantize your PyTorch model for inference using Intel Neural Compressor" to notebook under python folder

* Fix bug that markdown will be ignored inside html tags for nbconvert, and notebook revise

* Update guide 'How to quantize your PyTorch model for inference using Post-training Optimization Tools' to notebook under python folder

* Small updates to index and current guides

* Revision based on Junwei's comments

* Update how-to guides: How to install BigDL-Nano in Google Colab, and update index page

* Small typo fix
2022-09-02 10:17:06 +08:00
Cengguang Zhang
f8f717a684 Doc: update hadoop document. (#5623)
* doc: update hadoop document.

* fix: fix wording.

* fix: fix wording.

* fix: fix wording.
2022-09-02 08:05:43 +08:00
Juntao_Luo
0f1cfd82ff Chronos: installation panel enhancement (#5588)
* Update:installation panel enhancement
Left a bug to fix and install CMD to revise.

* Bugfix: Fixed a bug when using Firefox browser to use the install guide form.
Fixed the bug that the table's background color may be changed by mistake on Firefox browser.

* Update: update panel as comment required.

* Bugfix: fixed a bug in js file that will show wrong cmd when clicking 'windows' or 'docker'.

* Bugfix: fixed the bug that 'cmd' shows incorrectly when clicking 'prophet' and 'ARIMA'.
2022-09-01 21:11:59 +08:00
Yuwen Hu
57e46c6160 [Documentation] Add Extension nbsphinx-link (#5596)
* Add extension nbsphinx-link: link notebook out of the sphinx root folder to the sphinx project

* Link Notebook custom.ipynb directly from python folder to the sphinx project

* Link Notebook seq_and_func.ipynb directly from python folder to the sphinx project

* Small title fix

* Make interactive graphs visible in readthedocs webpage for seq_and_func.ipynb

* Regenerate outputs for custom.ipynb and remove parts of them
2022-09-01 11:54:24 +08:00
Jason Dai
9e76c7e16e Update powered-by.md 2022-08-31 21:20:56 +08:00