ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
856 commits 1 branch 0 tags 37 MiB
Commit graph

328 commits

Author SHA1 Message Date
Diankun An
bc50683f07 [PPML] Fl Server and Client Tls Support (#3916) 
* Add certChainFilePath and privateKeyFilePath to FLServer, FLHelper and ppml-conf.yaml.
* Build tls channel for FLClient.
* Update README and doc.
 2022-01-21 14:17:20 +08:00
Uxito-Ada
ac22864d9c [PPML] Modify Files about KMS (#3917) 2022-01-21 09:41:59 +08:00
Uxito-Ada
0713f3db26 [PPML] Add ehms KMS client (#3748) 
* [PPML] Add ehms kms client scripts

* Add timeout parameter in requests and INFO log

* Update DecryptFile.py

* Update EncryptFile.py

* Add 2 new api scripts

* Update EncryptFilesAutomation.py

* Update EncryptFile.py

Enable users to specify save_path in EncryptFile.py

* Update DecryptFile.py

Enable users to specify save_path in DecryptFile.py

* Add DecryptFilesAutomation.py and delete EncryptFromMemory.py

* Move kms-client to ppml/

* Update Dockerfile

* Add .py, .sh and .jar files for kms e2e example

* Update Dockerfile

* Update kms-saprk-e2e-example.sh

Fresh the kms-spark-e2e-example.sh to successfully tested version

* Do not use plaintext in shell anymore

* Update DecryptFilesWithSpark.sh

* Update kms-e2e-example.sh

* Delete log

* Update Dockerfile

* Update Dockerfile

Turn to the schema that mount kms-client folder when run docker

* Update Dockerfile

* Copy requirement file to trusted-big-data-ml/python/docker-graphene

* Add the READEME doc for kms

* Modify README

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Convert from mounting to pre-copying

* Enable SSL/TLS in spark job

* Update README.md

* Update README.md

* Update build-docker-image.sh

* Update build-docker-image.sh

* Convert .db to multiple .csv first before encryption

* Update EncryptDBAutomation.py

* Update README.md

* Update EncryptDBAutomation.py

* Update requirement.yml

Specify the cryptography version to solve the overflowerror when input data size>2.8G

* Remove the example and update APIs

* Modify codes according to reviews

* Resolve the bug about multi-file col-encryption and repetitive encryption

* Update kms-e2e-example.sh

Remove debug codes.

* Update kms-e2e-example.sh

move SGX output to log

* Add the jar for saprk column decryption

* Update EncryptDBAutomation.py

* Add API V2

* Update FileOperator.py

* Update KeyManager.py

* Update KmsApi.py

* Update RestCaller.py

* Update kms-e2e-example.sh

* Add two scripts for V2 KMS

* replace v1 API with v2

* Update Dockerfile

* Upload version that tested

* Update DecryptFilesWithSpark.sh

* Update README.md

* Refresh README

* Update README.md

* Update README.md
 2022-01-20 14:13:29 +08:00
Diankun An
fd1fc44d9d [PPML] Update trusted-fl doc (#3911) 
* [PPML] Update trusted-fl doc
* Update trusted_fl.md example part.
 2022-01-20 09:48:19 +08:00
liangs6212
ad47a0b8e0 Chronos: Move use-case to chronos-tutorial and modify page layout (#3868) 
* fix chronos deep_dive link error

* add use-case

* delete the use-case contained in chronos.md

* add space

* modify the index.md format

* change page style

* fix link error

* change title link

* fix repo error

* change to relative path

* remove extra symbols

* add \n

* change use-case title

* fix anomaly detection link error
 2022-01-13 11:11:40 +08:00
Junwei Deng
625a8f89fe Chronos: Refactor document structure (#3839) 
* add strcture change

* add change in index

* add change to index.rst

* revice the document

* add icons

* revise on the pages

* add readme update

* remove ood information

* change title
 2022-01-08 16:40:46 +08:00
Song Jiaming
12dca51115 Update serving doc 2022-01-07 10:20:58 +08:00
dding3
837bd6a58f Add save/load comments in keras docs (#3820) 2022-01-05 15:01:08 +08:00
liangs6212
a0ba173310 Chronos: New built-in dataset (uci_electricity) (#3795) 
* add electricity load

* add ut and change doc description

* rename uci_electricity

* rename function
 2021-12-28 15:57:29 +08:00
joan726
4218f11379 Branch docs (#3677) 
Co-authored-by: Kai Huang <huangkaivision@gmail.com>
 2021-12-23 15:46:53 +08:00
Song Jiaming
a677feaf60 Update serving-quickstart.md 2021-12-23 10:31:12 +08:00
dding3
029216909d expose getModel in pynnmodel (#3778) 2021-12-22 18:27:17 +08:00
dding3
862c530685 add get model in nnframe doc (#3776) 
* add get model in nnframe doc
 2021-12-22 15:38:18 +08:00
Song Jiaming
f27f2e9d3a PPML VFL evaluation and predict support (#3714) 2021-12-21 14:30:12 +08:00
Le-Zheng
e5d2004933 hotfix k8s doc (#3718) 2021-12-14 09:55:52 +08:00
Junwei Deng
d58d47d2fc Chronos: Fix forecaster doc (#3690) 
* add torchmetrics in doc

* add nano

* add doc fix
 2021-12-09 16:27:28 +08:00
Le-Zheng
18d5e6a7a0 Update docker.md 2021-12-09 13:49:13 +08:00
Le-Zheng
aa157429d9 tf quickstart yarn integration test (#3671) 2021-12-08 10:10:21 +08:00
Jason Dai
edaef4aa4f Revert "Add blog content in readthedocs" (#3676) 2021-12-06 21:40:06 +08:00
joan726
77073f0430 Add blog content in readthedocs (#3675) 
* Create blog

* Create blog.md

* Update index.rst
 2021-12-06 21:29:01 +08:00
joan726
c4b0697fb0 Update presentations.md 2021-12-06 16:26:01 +08:00
joan726
61be6ce17a Update presentations.md 2021-12-06 11:47:13 +08:00
Song Jiaming
5a53081656 Remove internal ip in tests (#3665) 2021-12-03 15:45:37 +08:00
Song Jiaming
a83ab371d2 add serving index to readme (#3648) 2021-12-02 16:57:17 +08:00
Le-Zheng
1951149792 update docker use guide readthedocs (#3628) 2021-12-01 09:13:37 +08:00
helenlly
181e086cff update Python User Guide and Scala User Guide with supported platforms info (#3593) 
* Update python.md

* Update scala.md

* Update python.md

* Update scala.md

* Update python.md

* Update scala.md

* Update python.md

* Update scala.md

* Update python.md

* Update python.md

* Update scala.md
 2021-11-30 09:30:48 +08:00
Kai Huang
dffeda5e1e Update k8s user guide for run from remote (#3606) 
* update doc

* minor

* update

* fix

* minor

* minor

* fix
 2021-11-26 17:54:13 +08:00
Uxito-Ada
6c1c0e46b1 [PPML] Fix Kubernetes typo PPML QuickStart doc (#3590) 
* Fix Kubernetes typo PPML QuickStart doc
* Rename the doc title
* Fix link
 2021-11-26 09:50:52 +08:00
Jason Dai
e5047b9cb0 Update orca-tf2keras-quickstart.md 2021-11-24 19:44:36 +08:00
Xin Qiu
ee95ab6198 revert 3366 (#3547) 2021-11-23 13:23:46 +08:00
Le-Zheng
bee5879b24 update k8s docs (#3461) 2021-11-19 17:17:05 +08:00
Uxito-Ada
30b4c3d9d5 [PPML] Add deploy_intel_sgx_device_plugin_for_kubernets in QuickStart (#3512) 
* [PPML] Add deploy_intel_sgx_device_plugin in QuickStart
* Append k8s-deploy doc in index.rst
 2021-11-18 10:44:29 +08:00
Le-Zheng
c75ad40e67 update orca data quickstart and ray md (#3498) 2021-11-16 17:41:48 +08:00
Le-Zheng
238a434950 Update colab notebooks (#3486) 2021-11-16 17:16:11 +08:00
Le-Zheng
b746200b35 update readthedoc quickstart link (#3489) 
* update readthedoc quickstart link

* update notebook link
 2021-11-16 17:07:50 +08:00
liangs6212
27302a4e5f Chronos: Forecaster in doc shows more friendly (#3441) 
* add hyperlinks

* fix style error

* remove space

* remove typo "mtnet"
 2021-11-16 11:24:07 +08:00
Le-Zheng
4c5a0b9729 BigDL2.0 colab user guide (#3225) 
* BigDL2.0 colab user guide
 2021-11-15 14:05:29 +08:00
Xin Qiu
453c991c19 Update hadoop.md (#3433) 
* Update hadoop.md

* Update hadoop.md

* Update hadoop.md

* add pyspark with dllib

* some update

* add spark-submit-with-dllib

* Update hadoop.md

* Update hadoop.md

* Update hadoop.md

* Update hadoop.md

* Update hadoop.md

* Update hadoop.md

* Update hadoop.md

* Update hadoop.md

* Update hadoop.md
 2021-11-12 13:34:04 +08:00
Yu Shan
829ee31f1b Add document for Orca PytorchRayEstimator and PytorchSparkEstimator (#3458) 
* add document for pytorch_ray_estimator and pytorch_spark_estimator

* change module to class

* fix typo
 2021-11-11 19:41:37 +08:00
liangs6212
dffc40630b Chronos: Change the redownload method (#3211) 
* change redownload,with_split default True.

* remove float

* fix "network_traffic" typo

* add built-in dataset api doc
 2021-11-11 16:54:31 +08:00
liangs6212
7abdb01c1c Move AutoML API Guide to Orca API Guide (#3415) 
* move automl-api-guide to orca-api-guide

* change title
 2021-11-08 09:53:41 +08:00
dding3
0f20dabda3 add dllib quickstart (#3416) 
* add dllib quickstart
* fix init_nncontext issue
 2021-11-07 21:21:49 +08:00
dding3
2202949eac integrate dllib.md with scala.md (#3388) 
* integrate dllib.md with scala.md

* add how to run in cluster for python dllib
 2021-11-04 20:22:58 +08:00
Junwei Deng
bff3a2250e Chronos: link updates for api docs (#3395) 
* add link updates

* add changes
 2021-11-04 15:09:10 +08:00
liangs6212
e43a06b13a Add AutoXGBoost API Guide (#3376) 
* add auxo-xgb api guide

* add example code

* change description

* add "\n"

* fix paragraph
 2021-11-04 14:41:34 +08:00
Xin Qiu
17060f541a change engine's required configuration to warning (#3366) 
* change engine's error to warning

* delete spark.shuffle.reduceLocality.enabled

* Update test_spark-bigdl.conf

* Update EngineSpec.scala

* Update test_zoo_utils.py

* Update test_image3d.py

* Update AnalyticsZoo-on-Databricks.md

* Update databricks.md

* Update test_zoo_utils.py
 2021-11-03 09:35:37 +08:00
helenlly
f185a608ce Update powered-by.md (#3334) 
add whitepaper: Reference Architecture for Confidential Computing on SKT 5G MEC
 2021-11-01 18:16:41 +08:00
Qiyuan Gong
8b610482b7 [PPML] Refine PPML readthedocs (#3355) 
* Link ppml docs to readthedocs page
* Copy trusted_fl, build_kernel from narwhal
* Copy trusted_big_bata_analytics_and_ml.md from zoo
 2021-11-01 12:54:46 +08:00
Junwei Deng
ac96d9a35a Chronos: update Chronos quickstart from az to bigdl (#3324) 
* fix anomaly detector qs

* fix autoest notebook

* add updates

* add qs name

* update logo

* fix installation guide

* fix typos
 2021-10-29 12:59:21 +08:00
Yu Shan
26c087d493 Update AutoXGBoost and AutoEstimator Quickstart (#3327) 
* change document

* update quick start notebook

* update autoestimator pytorch quickstart

* update doc

* update notebook

* change logo

* update install
 2021-10-29 10:23:15 +08:00
Yu Shan
d92e68dd78 Update Chronos setup (#3328) 
* update Chronos setup

* meet comments

* remove redundant dependencies for ray in orca[automl]
 2021-10-29 10:22:16 +08:00
Yina Chen
0334eda6fe Update orca docs (#3278) 
* update orca docs

* update colab

* update

* meet comments

* update

* update
 2021-10-28 17:45:30 +08:00
Yu Shan
bc8d5733e8 Update Automl pytorch quickstart (#3306) 
* update quick start doc

* change code and link

* Update image

* colab link

* update link and name

* Update install guide link
 2021-10-28 15:25:42 +08:00
Yu Shan
b622d60048 Add installation guide in Orca AutoML Doc (#3304) 
* add install guide in orca.automl doc

* typo

* update

* add sklearn and tensorboard
 2021-10-28 14:45:16 +08:00
Junwei Deng
49af13e215 Chronos: user guide revision/update (#3220) 
* add new content to ug of chronos

* add link revise

* fix broken links

* add changes according to comments

* add updates

* fix typos

* change typos
 2021-10-28 11:20:14 +08:00
Yu Shan
ebc58fa419 Change Analytics Zoo to BigDL in python user guide (#3255) 
* change analytics zoo to bigdl

* remove version check since we haven't support it yet

* add pip uninstall
 2021-10-27 14:27:28 +08:00
Yu Shan
cda4102745 update orca automl doc with bigdl (#3297) 
* update orca automl doc

* typo
 2021-10-27 14:25:29 +08:00
Kai Huang
0d0cff81fd Update RayOnSpark doc (#3242) 
* update doc

* update ray dependency

* meet review
 2021-10-27 11:31:07 +08:00
helenlly
044cb339ce Update release.md (#3250) 
* Update release.md

* Update release.md

* Update release.md

add bigdl-dllib package download links

* Update release.md
 2021-10-27 10:26:11 +08:00
dding3
8ba635c101 add dllib user guide (#3212) 
* add dllib user guide

* add spark-submit-with-bigdl script

* copy scripts to zip
 2021-10-26 14:07:41 +08:00
Xin Qiu
a3dc9a0158 Update scala docs (#3248) 
* Update scala.md

* Update scala.md

* Update scala.md

* Update scala.md

* Update scala.md

* Update scala.md
 2021-10-26 09:16:22 +08:00
Xin Qiu
3c316e0071 update hadoop/yarn user guide (#3249) 
* Update hadoop.md

* Update hadoop.md

* Update hadoop.md

* Update hadoop.md

* Update hadoop.md
 2021-10-26 09:15:46 +08:00
Qiyuan Gong
6555044e11 [PPML] PPML user guide (#3210) 
* Replace name and link
* Fix links
 2021-10-25 13:47:02 +08:00
Yina Chen
98ba6d5e80 Update orca & friesian readthedocs (#3182) 
* update readthedocs

* add path

* update
 2021-10-22 14:56:00 +08:00
liangs6212
6137a08ddf Chronos: Fix the display problem of API doc (#3208) 
* fix rst path

* recipe api doc error

* rename title

* Uniform name format
 2021-10-22 12:15:07 +08:00
Jason Dai
4c8d424bcb Update document (#3176) 2021-10-21 11:29:53 +08:00
Jason Dai
269b182b04 Update readthedocs (#3165) 2021-10-20 21:51:04 +08:00
pinggao187
c876e474af update readthedocs conf (#3158) 
reviewed， LGTM。  Co-authored-by: gaoping <pingx.gao@intel.com>
 2021-10-20 18:28:57 +08:00
helenlly
2050ea16a6 Update conf.py 
changed words with "Analytics Zoo" to "BigDL"
 2021-10-20 14:55:45 +08:00
Jason Dai
bea3d5e18c Update index.rst 2021-10-20 14:35:16 +08:00
Jason Dai
93207fcd37 Update index.rst 2021-10-20 09:00:57 +08:00
Jason Dai
3049802582 Update index.rst 2021-10-20 09:00:28 +08:00
Qiyuan Gong
07f6f3e5dd [BigDL 2.0][PPML] PPML readthedocs refine (#5024) 
* PPML Overview
* Benchmark doc
 2021-10-19 10:28:17 +08:00
Jason Dai
547f88ab22 Add files via upload 2021-10-18 16:59:17 +08:00
Jason Dai
929ace496e bigdl_logo 2021-10-18 16:23:36 +08:00
Song Jiaming
89a326e038 bigdl 2.0 serving doc (#4995) 2021-10-15 15:50:15 +08:00
jenniew
71838b1977 [BigDL-2.0] Update Databricks documents (#4956) 
* upate doc

* update
 2021-10-14 15:42:33 -07:00
gaoping
21543a05ed add docs 2021-10-12 11:06:44 +08:00