Commit graph

740 commits

Author SHA1 Message Date
Hu, Zhaojie
4d56ece258 [Chronos] Add install options in chronos-nightly docker image (#6064)
* add install options for chronos dockerfile

* add invaild argument check

* add arg num check & add extra_dep arg

* remove debug message

* add build args message in README & change arg num check message

* add ml option in arg model

* add default value for each build arg

* update readme and howto guides

* fix typo

* fix typo

* fix markdown

* fix markdown
2022-10-13 22:20:28 +08:00
Shaojie Cui
c40a88e8ae [PPML]fix: change the image name to lowercase (#6107) 2022-10-13 09:43:12 +08:00
Heyang Sun
543e06b710 Update manually_build.yml 2022-10-13 09:39:00 +08:00
Heyang Sun
b31d73ca31 Update manually_build.yml 2022-10-12 16:26:12 +08:00
Heyang Sun
38635d204b Update manually_build.yml 2022-10-12 15:08:50 +08:00
Heyang Sun
6e9450bb9e Update manually_build.yml 2022-10-12 14:51:52 +08:00
Heyang Sun
12330ebb7a Update manually_build.yml 2022-10-12 14:51:17 +08:00
Heyang Sun
4dac2606ad Update manually_build.yml 2022-10-12 14:48:13 +08:00
Heyang Sun
d8d4a05916 Update manually_build.yml 2022-10-12 14:46:36 +08:00
Heyang Sun
fc3fb94e23 push base image as well 2022-10-12 13:59:01 +08:00
Heyang Sun
0e94e70b85 Rename base image name in docker build command 2022-10-12 13:19:26 +08:00
Jason Dai
8fdd068ca0 Update Project Readme (#6086) 2022-10-11 16:49:30 +08:00
Heyang Sun
6140b81eab unannotated docker push 2022-10-11 15:42:24 +08:00
Shengsheng Huang
fbd5a57f93 add windows user guide (#5950)
* add windows user guide

* modifiy win user guides

* Add jupyter setup guide and known issues

* Add tips for yolov3 example

* update win guide

* update win guide

* update win guide reference

* update win guide reference

* update win guide reference

* format fix

* revise nano and chronos windows guide

* fix windows guide reference in nano install

Co-authored-by: aixideng <aixi.deng@intel.com>
2022-10-11 13:14:40 +08:00
Heyang Sun
fb0f9a35b9 delete enclave key after build 2022-10-11 10:38:29 +08:00
Heyang Sun
53b9f8d958 add new gramine image build action 2022-10-11 10:37:00 +08:00
Junwei Deng
28acefdb7c Chronos: update installation guide to reflect our work on better tensorflow support (#6066) 2022-10-10 17:31:02 +08:00
Song Jiaming
42934c9abe PPML refine keras VFL support (#6059) 2022-10-10 15:13:29 +08:00
Song Jiaming
b7be0c8c44 PPML FL document (#6017) 2022-10-08 10:22:32 +08:00
Jian Zhou
936f8d2adb update databricks doc (#6035)
Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-30 17:03:30 +08:00
Yuwen Hu
d262848421 [Document] Add API docs for bigdl.nano.tf.keras.layers.Embedding and bigdl.nano.tf.optimizers.SparseAdam (#5967)
* Add api docs for bigdl.nano.tf.keras.layers.Embedding and bigdl.nano.tf.optimizers.SparseAdam

* Update API document link in related how-to guide

* Remove non-related parameter explanation for Embedding

* Add param explanation for kwargs in for Embedding, and small revision

* Small fix
2022-09-30 13:14:42 +08:00
Ruonan Wang
f3c8ae37f1 Chronos : How to generate confidence interval for prediction (#5817)
* first commit

* fix version conflict in colab

* update based on comment

* change val_data to validation_data

* remove exit()
2022-09-28 14:34:20 +08:00
Shaojie Cui
27587b5db5 [PPML]doc: fix TPCH markdown list number render (#5992)
* Fix list number rendering wrongly

* position of the ellipsis
2022-09-28 11:07:48 +08:00
Jian Zhou
a703ae4eba Update Databricks user guide (#5920)
* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-28 09:47:18 +08:00
Yang Wang
0d696fcf92 Add tensorflow known issue for inter op parallelism cannot be modified (#5923)
* Add tensorflow known issue for inter op parallelism cannot be modified

* try clear session

* remove clear session
2022-09-27 10:45:43 -07:00
Le-Zheng
b9c73c4c20 add release link on main (#5981)
* add release link on main

* Update release.md
2022-09-27 16:58:35 +08:00
Wang Jian
a74d08b52b [PPML] Add Occlum-production to github action (#5976) 2022-09-27 16:00:05 +08:00
Qiyuan Gong
97b925e584 [PPML] Refine install SGX driver from Kernel document (#5978)
* Add Mellanox issue
* Add SYSTEM_REVOCATION_KEYS issue
* Fix typo
* Add libelf-dev
2022-09-27 15:55:04 +08:00
SONG Ge
79f29244d8 [Orca] Add bigdl-submit mode support (#5960)
* add bigdl-submit mode support

* modify all submit-with-bigdl

* remove submit-with-bigdl info
2022-09-27 15:17:41 +08:00
Dongjie Shi
bff6795199 update action to publish images (#5966) 2022-09-26 17:27:11 +08:00
Yuwen Hu
331c3054d9 [Nano] How-To Guides: Training - TensorFlow (#5836)
* Add basic guides structure of Training - TensorFlow

* Add how-to guides: How to accelerate a TensorFlow Keras application on training workloads through multiple instances

* Change import order and add pip install for tensorflow-dataset

* Diable other nano tests for now

* Add github action tests for how-to guides Tensorflow training

* Use jupyter nbconvert to test notebooks for training tensorflow instead to avoid errors

* Add how-to guide: How to optimize your model with a sparse Embedding layer and SparseAdam optimizer

* Enable other nano tests again

* Small Revision: fix typos

* Small Revision: refactor some sentences

* Revision: refactor contents based on comments

* Add How-to guides: How to choose the number of processes for multi-instance training

* Small Revision: fix typos and refactor some sentences

* Make timeout time for github action longer for TensorFlow, 600s->700s
2022-09-26 15:40:22 +08:00
pinggao187
0cabc79133 change spark313 to spark312 (#5956) 2022-09-26 15:18:54 +08:00
Ruonan Wang
55c793c455 Nano : Update pytorch inference QuickStart with InferenceOptimizer (#5899)
* replace Trainer with InferenceOptimizer

* add warning note for deprecation of trainer.trace / trainer.quantize
2022-09-26 09:52:34 +08:00
pinggao187
0af2711dbf update pypi/spark version (#5925) 2022-09-23 14:30:49 +08:00
Qiyuan Gong
db2f80fbd8 [PPML] Refine grammar of PPML readthedoc (#5875)
* Refine grammar of secure_your_services, trusted_fl, secure_your_services, trusted_big_data_analytics_and_ml and ppml.
2022-09-21 10:37:07 +08:00
Yuwen Hu
56990ebb4a [Document] Reword "Edit on Github" Button (#5802)
* Overide sphinx_rtd_theme style to remove 'Edit on Github' button

* Change 'Edit on Github' button to 'Edit this page' for every readthedocs pages

* Add lisence for adapting sphinx_rtd_theme/breadcrumbs.html
2022-09-20 16:26:27 +08:00
Ruonan Wang
13e3137cfd Fix a bug of readthedocs about get_public_dataset (#5808) 2022-09-19 09:12:25 +08:00
Jian Zhou
5c453157de update Databricks user guide (#5779)
* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

* update databricks doc

Co-authored-by: Zhou <jian.zhou@intel.com>
2022-09-16 10:31:55 +08:00
Jiao Wang
a1c9182515 [PPML] Fix BigDL Graphene Azure scripts (#5767)
* update

* update submit scripts
2022-09-15 18:47:38 -07:00
Kai Huang
c49b52a95b Update multi-task example (#5787)
* update multi-task

* fix

* minor

* minor
2022-09-16 09:45:43 +08:00
binbin Deng
88faa59eb4 Chronos: how to evaluate using forecaster (#5710) 2022-09-16 09:06:27 +08:00
WangBin
fced58a044 Add Friesian multi task example code and readme (#5460)
* add multi task example codes and readme

* fix for Friesian code style

* part 1: fix comments in pr

* update for comments part 2

* update for pr comments part 3

* update for code style

* update codes and add test results

* Update README.md
2022-09-15 21:03:53 +08:00
Cengguang Zhang
de91a8ccd7 Doc: add ray port FAQ to ray overview document. (#5752)
* feat: add faq to ray overview doc.

* fix: fix doc style.

* fix: fix typo.

* feat: add ray redis and dashboard port conflict to faq.

* fix: fix redis port param name.

* fix: fix redis port param name.

* fix: fix typo

* fix: fix typo

* fix: fix wording.
2022-09-15 19:26:10 +08:00
Ruonan Wang
edcab051a9 Nano : add API for InferenceOptimizer and deprecated some Trainer APIs (#5768)
* add api and deprecated

* add license

* add deprecated

* update comment for api display

* modify comment

* update based on comment
2022-09-15 18:43:47 +08:00
Shaojie Cui
d07e862bec PPML: mod TPCH document (#5583)
* doc: modify markdown grammar typo

* doc: md typo

* typo

* fix

* fix

* fix

* hint

* correct argument

* add path of password to container

* fix syntax errors

* fix

* fix
2022-09-15 16:27:09 +08:00
binbin Deng
b9186b56ef Chronos: fix install cmd in Chronos User Guide document (#5776) 2022-09-15 15:36:50 +08:00
Yuwen Hu
12c12a1058 [Nano] How-To Guides: Training - PyTorch Lightning (#5643)
* Rearrange file structure for PyTorch Inference for docs and add titles for PyTorch-Lightning Training

* Add How-to guide: How to accelerate a PyTorch-Lightning application on training workloads through Intel® Extension for PyTorch*

* Add how-to guide: How to accelerate a PyTorch-Lightning application on training workloads through multiple instances

* Revise: remove '-' in 'PyTorch-Lightning' and some other changes

* Add How-to guides: How to use the channels last memory format in your PyTorch Lightning application for training

* Add how-to guide: Use BFloat16 Mixed Precision for PyTorch Lightning Training

* Add How-to guide: How to accelerate a computer vision data processing pipeline

* Small Revision: change comments in several code cells

* Disable other nano tests temporarily

* Add github action tests for Nano Training PyTorch Lightning tests

* Enable other nano tests again

* Small revisions: typos and explanation texts changes

* Revise: update based on comments
2022-09-15 15:26:11 +08:00
Wang Jian
528ff064f5 [PPML] Remove XGBoost from PPML guide 2022-09-15 12:03:40 +08:00
Yuwen Hu
3a19ebbfbf Add ipython extension for rendering code blocks in excuted notebooks properly in our readthedocs project (#5757) 2022-09-14 17:25:55 +08:00
ZehuaCao
732850ef3a [PPML] change KMS appkey to apikey (#5658)
* change appkey to apikey

* change APiKEY to APIKEY

Co-authored-by: Heyang Sun <60865256+Uxito-Ada@users.noreply.github.com>
2022-09-13 15:44:23 +08:00