ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
672 commits 1 branch 0 tags 37 MiB
Commit graph

214 commits

Author SHA1 Message Date
Shane Huang
b53074af53 fix docs (#4992) 2022-07-01 12:14:43 +08:00
Shane Huang
41a28c317f update visualization docs (#4980) 
* update docs
 2022-06-30 23:08:12 +08:00
Le-Zheng
cef5359c54 update tpch doc (#4979) 2022-06-30 12:59:31 +08:00
Junwei Deng
26ec59edf7 Chronos: add autoformer example on electricity and api doc (#4950) 
* add autoformer example and api doc

* update license and readme
 2022-06-28 17:37:20 +08:00
Jason Dai
b23f66ebbc Update Readme (#4957) 
* Update README.md

* Update index.rst

* Update README.md
 2022-06-28 09:27:40 +08:00
Song Jiaming
18a9c2f57a PPML FGBoost tutorial draft (#4751) 2022-06-27 15:46:52 +08:00
David smurf
500b7bbe99 Chronos: add tf forecaster doc (#4923) 2022-06-27 11:33:41 +08:00
Junwei Deng
76608a5034 Orca: add dashboard.log error in known issue (#4943) 
* add dashboard.log error

* add title

* typo fix
 2022-06-27 11:10:24 +08:00
Shan Yu
86fa1c02ab Rename Orca Tensorflow Estimator backend name from "tf2" to "ray" (#4938) 
* rename backend name from tf2 to ray

* rename in doc

* rename in docstring

* manually

* rename test_tf2estimator_tf2_backend.py -> test_tf2estimator_ray_backend.py

* change tf2 in multi_agent_two_trainers.py back
 2022-06-27 08:40:33 +08:00
Shan Yu
8f51ed4cf1 Add Orca Known issues (#4940) 2022-06-24 16:45:41 +08:00
Mingzhi Hu
145216bfc1 Update pytorch to 1.11 (#4854) 
* update setup and action

* fix yml

* update yml

* test yml

* update docs

* update notebook requirements

* test notebooks unit test

* reset yml

* delete comments

* fix yml

* fix errors in setup.py

* fix setup.py

* specify the version of IPEX
 2022-06-24 16:38:48 +08:00
Rebekk
8e10bdeabd Chronos: add Evaluator doc (#4889) 
* add evaluator doc

* add index
 2022-06-21 09:47:25 +08:00
Zhentao Chen
7dcd79366f doc fix (#4829) 2022-06-15 08:23:01 +08:00
Nancy
04542bc6db Fix code style in PyTorch QuickStart (#4821) 
* fix two issues

* fix two issues
 2022-06-14 09:58:43 +08:00
Zhentao Chen
e7c7ab2b8e [Nano] add tf inference doc (#4797) 
* add tf inference doc

* fix doc

* grammarly check

* add sequential
 2022-06-13 08:54:48 +08:00
jenniew
f687e4b684 Update Azure PPML doc (#4809) 
* add script

* update

* update

* update scripts and doc

* update pass

* update

* update docker

* update

* aks script

* update create aks

* add doc

* update

* vm size note
 2022-06-12 17:22:43 -07:00
jenniew
6aeabae58b Azure PPML support (#4660) 
* add script

* update

* update

* update scripts and doc

* update pass

* update

* update docker

* update

* aks script

* update create aks

* add doc

* update
 2022-06-12 17:06:24 -07:00
Jason Dai
c8a07474ee Update index.rst 2022-06-10 21:50:04 +08:00
Mingzhi Hu
2c4623f8da Update pytorch_train.md (#4786) 
* Update pytorch_train.md

Add description about torchvision version

* Update pytorch_train.md
 2022-06-09 08:39:44 +08:00
Yang Wang
20ad708010 Add Nano PyTorch API Doc (#4730) 
* add trainer api doc

* add index and fix trainer

* fix doc

* reset

* fix conflict

* fix import
 2022-06-08 17:45:24 +08:00
jenniew
e150593602 Azure PPML documentation (#4675) 
* az doc

* update

* update
 2022-06-07 08:20:24 -07:00
Zhentao Chen
900711f1b3 [Nano] add pytorch inference doc (#4656) 
* pytorch inference doc init commit

* quantization with tuning

* fix grammarly

* remove val_dataloader

* specify version
 2022-06-02 14:42:00 +08:00
Shane Huang
8ced71c488 revise hpo doc (#4735) 2022-05-31 17:35:52 +08:00
Shane Huang
e24859c39b add resume and parallel search docs (#4734) 2022-05-31 17:08:23 +08:00
liangs6212
0af87a18c6 Chronos: Fix readthedocs.io build error (#4720) 
* add pickle5 version

* fix doc issue

* fix import bigdl.nano in doc

* renamed basepytorchmodel to baseautomodel

* renamed again
 2022-05-30 17:52:20 +08:00
Shan Yu
5bc293b9c5 Update Chronos installation guide (#4698) 2022-05-26 10:20:33 +08:00
Le-Zheng
db2818c8f7 update databrciks doc (#4691) 2022-05-26 07:41:44 +08:00
Yang Wang
55fa3e13e6 Add Nano Known issues and some notebook link (#4667) 
* Add Nano Known issues and some notebook link

* fix typo
 2022-05-25 10:26:46 +08:00
Shane Huang
353e7ffbdf [Nano HPO] revised user guide (#4666) 
* revise doc

* revise doc

* revise docs again
 2022-05-24 14:42:42 +08:00
Shane Huang
993c80b427 [Nano HPO] user guide (#4639) 
* add initial version of hpo doc

* modify the doc index

* revised doc

* revise docs

* revise docs
 2022-05-23 21:33:27 +08:00
Yang Wang
4ab95fa3e4 Fix Nano TensorFlow Doc Link (#4634) 2022-05-19 09:30:30 +08:00
Yang Wang
aabeb3fe35 add nano documentation pages to readthedocs site (#4619) 
* add nano documentation pages to readthedocs site

* fix file name

* refine title

* fix typo
 2022-05-18 09:22:02 +08:00
Yang Wang
210677a295 Add nano documentation for pytorch training quickstart (#4577) 
* Add nano documentation for pytorch training quickstart

* fix some typo

* break pytorch training and inference to two files

* simplify trainer import

* fix train doc
 2022-05-16 14:14:30 +08:00
Yang Wang
25982b0d16 Add Nano TensorFlow Training QuickStart Doc (#4591) 
* Add Nano TensorFlow Training QuickStart Doc

* fix typo

* break training and inference to two files
 2022-05-16 10:46:16 +08:00
Yang Wang
0656804f56 Add windows guide to nano overview (#4599) 
* Add windows guide to nano overview

* add source cmmd
 2022-05-16 10:45:12 +08:00
Rebekk
cc2499aa44 Chronos: add chronos known issue (#4496) 
* add chronos known issue

* modify doc

* modify chronos_known_issue

* modify chronos issue

* modify

* modify issue

* modify chronos_known_issus
 2022-05-13 15:11:31 +08:00
dding3
05f6fd24b4 add error handling api guidance (#4557) 
* add error handling api guidance
 2022-05-09 09:34:31 -07:00
Yang Wang
fd1da60251 Add Nano doc structure and Nano overview (#4504) 
* Add Nano doc structrue and nano overview

* add sections

* add unset environment variable instructions

* restructure

* address comments
 2022-05-09 17:12:44 +08:00
Jason Dai
24cf032a91 Update powered-by.md 2022-04-28 11:07:07 +08:00
Xiaohang Fu
359d5a6989 [PPML] Update readthedoc of PPML (#4515) 
* Change standalone to k8s
* Update the doc
 2022-04-27 13:47:51 +08:00
Xiaohang Fu
80184dfd4f [PPML]Update the document of graphene (#4500) 
* Refine Graphene K8S doc
* Add SGX memory configuration image
 2022-04-26 14:04:15 +08:00
Junwei Deng
ada7b4b978 Chronos: document regular update (#4241) 
* add information changes

* update typos

* add typo changes

* update documents

* update chronos.md

* add updates

* fix rst

* add speed-up md

* fix broken links and typos, add tutorials
 2022-04-24 15:55:23 +08:00
Xiaohang Fu
96fa40b4f7 [PPML] Update the document of TPC-DS (#4447) 
* Update the document of TPC-DS
* Update style
 2022-04-19 16:10:24 +08:00
Xiaohang Fu
154f32ce97 [PPML] Modify the quickstart document of TPC-DS (#4441) 
* Change command order
* [PPML]Modify the quickstart document of tpc-ds
* Remove blank
 2022-04-19 09:56:05 +08:00
Le-Zheng
56aee11c82 fix version in docs (k8s/scala) (#4440) 
* fix version in docs (k8s/scala)

* update
 2022-04-18 16:26:44 -07:00
Qiyuan Gong
0e0fbaf3d6 [PPML] Readthedoc fix path and branch (#4431) 
* scala/docker-graphene to python/docker-graphene
* Branch 2.0 to main
 2022-04-18 19:41:47 +08:00
CharleneHu94
658a4286f2 [PPML] Update trusted-big-data graphene doc (#4434) 
* update trusted-big-data graphene doc

* Update tpc-h_with_sparksql_on_k8s.md
 2022-04-18 16:09:09 +08:00
Forest
793306c275 [PPML] Add TPC-DS QuickStart document (#4430) 
* [ppml] Add TPC-DS QuickStart document
* Modify index.rst
* Change command order
 2022-04-18 14:42:00 +08:00
Shan Yu
71cd125837 Rename backend name from “torch_distributed” to “ray” in Orca Pytorch Estimator (#4388) 
* change backend name from torch_distributed to ray

* update in examples and docs
 2022-04-12 09:29:21 +08:00
Kai Huang
0c0e99fee5 Fix spark-submit scripts and doc (#4344) 
* fix yarn client

* fix shell script

* revert sh

* revert

* update doc

* finish doc update

* fix

* minor
 2022-04-06 19:27:43 +08:00
liangs6212
39f7fd2d1f Chronos: migrate from tf1.15 to tf2 (MTNetForecaster) (#4334) 
* convert mtnet_forecaster

* fix conflict

* add batch_size

* fix conflict

* change description

* change description again

* fix doc

* change param description
 2022-04-06 14:55:55 +08:00
SONG Ge
23aa10345f [Orca] Update Documents for Tf2estimator on Pyspark Backend (#4308) 
* update tf2estimator on pyspark backend docs
 2022-03-31 09:49:56 +08:00
SONG Ge
5d4743a12a [Orca] Update Orca Python API Docs (#4327) 
* update orca api docs
 2022-03-30 16:48:39 +08:00
Qiyuan Gong
6309dbd16b [PPML] Upgrade Kernel version to 5.14 in build from kernel (#4255) 
* Upgrade Kernel version to 5.14 in build from kernel
* Add 5.13 nfs issue
 2022-03-16 17:08:32 +08:00
Qiyuan Gong
93ea53e1e4 [PPML]Upgrade PPML image version to 2.1.0-SNAPSHOT in readthedoc (#4253) 
* Upgrade PPML image version to 2.1.0-SNAPSHOT in readthedoc
 2022-03-16 16:02:12 +08:00
Heyang Sun
d473177599 [PPML] Update graphene version number on main branch (#4250) 
* Update graphene version number on main branch
 2022-03-15 16:45:29 +08:00
Song Jiaming
e4830fa51d Python fgboost test and some test refactor (#4227) 2022-03-15 15:00:16 +08:00
Diankun An
a92813e710 [PPML] Update FL Demo BigDL Version (#4233) 
* [PPML] Update FL Demo BigDL Version
 2022-03-14 17:23:20 +08:00
dding3
b886ee86a7 add python getting started and add python freeze support (#4162) 2022-03-10 09:45:28 -08:00
liangs6212
077cc9f979 Chronos: Sync file paths in doc, branch-2.0-->main (#4091) 
* change branch-2.0 to main

* change branch-2.0 to main

* colab and github
 2022-03-10 16:00:53 +08:00
Le-Zheng
cb08b03fcd update release link to main branch (#4213) 
* update release link

* update
 2022-03-09 15:34:26 +08:00
Le-Zheng
e971385798 update docker version to 2.1.0-SNAPSHOT in docs (#4150) 2022-03-01 18:37:53 -08:00
dding3
63c96a9acb update zoo related doc to bigdl (#4058) 2022-02-18 11:07:36 -08:00
Xin Qiu
193a063504 update Scala doc (#4055) 
* Update develop.md

* update scala/pom.xml
 2022-02-18 10:38:24 +08:00
dding3
43bc582a02 Add getting start guidance for dllib (#3775) 
* add gettting start for dllib
 2022-02-17 16:43:42 -08:00
Kai Huang
2f39947b16 Update Python Develop Guide (#4054) 
* fix docs

* update

* update

* update

* update

* update
 2022-02-17 15:06:31 +08:00
Junwei Deng
1375438de3 Chronos: add updated information about models and Nano to document (#4048) 
* add updated information about models and Nano

* fix false formate

* add quantization related information

* fix missing quantization api doc

* fix typos
 2022-02-17 11:10:12 +08:00
Kai Huang
c9be2b979e Fix Ray QuickStart doc (#4053) 2022-02-17 10:05:50 +08:00
SONG Ge
065812c675 update orca context readme (#4050) 2022-02-16 17:15:14 +08:00
Le-Zheng
7f172c4df2 docker image jupyter (#3938) 
> Is this PR tested and ready for merge?
yes
 2022-02-16 01:05:52 -08:00
SONG Ge
656561153c Update Orca Context Readme (#4049) 
* update orca context readme
 2022-02-16 16:47:12 +08:00
Shan Yu
5500241dca remove tsfresh to solve doc building conflict for protobuf version (#4047) 2022-02-16 15:49:09 +08:00
Shan Yu
ce7a812623 Upgrade Ray version to 1.9.2 in documents and setup (#4037) 
* upgrade ray 1.2.0 to 1.9.2 in documents

* change ray version 1.9.0 to 1.9.2 in setup
 2022-02-16 12:21:58 +08:00
Song Jiaming
1422e99b56 Rename all serving doc containing word: zoo (#4024) 2022-02-15 15:49:14 +08:00
Song Jiaming
cd06909e0f rename to BigDL (#4020) 
Co-authored-by: Jiaming <litchilitchy@qq.com>
 2022-02-15 11:11:03 +08:00
Uxito-Ada
5446123cde [PPML] Refine kms-client (#4011) 
* [PPML] Refine kms-client

* Update submit-spark-job-with-kms-local-sgx.sh

* Update submit-spark-job-with-kms-local-sgx.sh
 2022-02-14 13:31:04 +08:00
Le-Zheng
a3a202e335 Update k8s doc (#3999) 2022-02-10 23:41:43 -08:00
Qiyuan Gong
e6a04e2ed2 [PPML] Change FL image name (#3991) 
* Change FL image name
 2022-02-10 20:41:49 +08:00
Qiyuan Gong
6846feb44e [PPML] Refine Trusted FL Doc (#3967) 
* Refine overview
* Refine Prerequisite

* Refine example

* Refine typo
 2022-02-09 10:09:19 +08:00
joan726
1e09804c37 Update powered-by.md (#3937) 
Co-authored-by: Qiyuan Gong <qiyuan.gong@intel.com>
 2022-02-07 19:04:02 +08:00
Jason Dai
965e176acc Update powered-by.md 2022-02-04 21:22:04 +08:00
Jason Dai
12707bb9ff Update powered-by.md 2022-02-04 21:08:14 +08:00
yizerozhuang
d75bf4450a [PPML] Refine PPML Readthedoc User Guide (#3950) 
* Fix typo and sentences
* Add links for keywords
 2022-01-27 15:03:04 +08:00
liangs6212
f560005d21 Chronos: add NBEATSForecaster API (#3880) 
* nbeats first version

* add nbeats_forecaster API

* Split automodel and forecaster

* fix typo

* modified params description

* pep8

* add nbeats doc

* fix typo and readthedocs error

* fix known bugs

* fix doc typo

* rename NBEATS to NBeats

* fix doc typo

* pep8

* fix errors in ut

* generic not support distributed

* pep8
 2022-01-27 11:03:48 +08:00
Kai Huang
77d32ba140 Add bigdl-spark3 in doc (#3932) 
* add spark3

* minor
 2022-01-24 15:22:12 +08:00
CharleneHu94
b49e3dcec8 [PPML] Add PPML TPC-H doc (#3928) 
* Add PPML Graphene TPC-H doc
 2022-01-24 11:27:16 +08:00
Diankun An
bc50683f07 [PPML] Fl Server and Client Tls Support (#3916) 
* Add certChainFilePath and privateKeyFilePath to FLServer, FLHelper and ppml-conf.yaml.
* Build tls channel for FLClient.
* Update README and doc.
 2022-01-21 14:17:20 +08:00
Uxito-Ada
ac22864d9c [PPML] Modify Files about KMS (#3917) 2022-01-21 09:41:59 +08:00
Uxito-Ada
0713f3db26 [PPML] Add ehms KMS client (#3748) 
* [PPML] Add ehms kms client scripts

* Add timeout parameter in requests and INFO log

* Update DecryptFile.py

* Update EncryptFile.py

* Add 2 new api scripts

* Update EncryptFilesAutomation.py

* Update EncryptFile.py

Enable users to specify save_path in EncryptFile.py

* Update DecryptFile.py

Enable users to specify save_path in DecryptFile.py

* Add DecryptFilesAutomation.py and delete EncryptFromMemory.py

* Move kms-client to ppml/

* Update Dockerfile

* Add .py, .sh and .jar files for kms e2e example

* Update Dockerfile

* Update kms-saprk-e2e-example.sh

Fresh the kms-spark-e2e-example.sh to successfully tested version

* Do not use plaintext in shell anymore

* Update DecryptFilesWithSpark.sh

* Update kms-e2e-example.sh

* Delete log

* Update Dockerfile

* Update Dockerfile

Turn to the schema that mount kms-client folder when run docker

* Update Dockerfile

* Copy requirement file to trusted-big-data-ml/python/docker-graphene

* Add the READEME doc for kms

* Modify README

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Convert from mounting to pre-copying

* Enable SSL/TLS in spark job

* Update README.md

* Update README.md

* Update build-docker-image.sh

* Update build-docker-image.sh

* Convert .db to multiple .csv first before encryption

* Update EncryptDBAutomation.py

* Update README.md

* Update EncryptDBAutomation.py

* Update requirement.yml

Specify the cryptography version to solve the overflowerror when input data size>2.8G

* Remove the example and update APIs

* Modify codes according to reviews

* Resolve the bug about multi-file col-encryption and repetitive encryption

* Update kms-e2e-example.sh

Remove debug codes.

* Update kms-e2e-example.sh

move SGX output to log

* Add the jar for saprk column decryption

* Update EncryptDBAutomation.py

* Add API V2

* Update FileOperator.py

* Update KeyManager.py

* Update KmsApi.py

* Update RestCaller.py

* Update kms-e2e-example.sh

* Add two scripts for V2 KMS

* replace v1 API with v2

* Update Dockerfile

* Upload version that tested

* Update DecryptFilesWithSpark.sh

* Update README.md

* Refresh README

* Update README.md

* Update README.md
 2022-01-20 14:13:29 +08:00
Diankun An
fd1fc44d9d [PPML] Update trusted-fl doc (#3911) 
* [PPML] Update trusted-fl doc
* Update trusted_fl.md example part.
 2022-01-20 09:48:19 +08:00
liangs6212
ad47a0b8e0 Chronos: Move use-case to chronos-tutorial and modify page layout (#3868) 
* fix chronos deep_dive link error

* add use-case

* delete the use-case contained in chronos.md

* add space

* modify the index.md format

* change page style

* fix link error

* change title link

* fix repo error

* change to relative path

* remove extra symbols

* add \n

* change use-case title

* fix anomaly detection link error
 2022-01-13 11:11:40 +08:00
Junwei Deng
625a8f89fe Chronos: Refactor document structure (#3839) 
* add strcture change

* add change in index

* add change to index.rst

* revice the document

* add icons

* revise on the pages

* add readme update

* remove ood information

* change title
 2022-01-08 16:40:46 +08:00
Song Jiaming
12dca51115 Update serving doc 2022-01-07 10:20:58 +08:00
dding3
837bd6a58f Add save/load comments in keras docs (#3820) 2022-01-05 15:01:08 +08:00
liangs6212
a0ba173310 Chronos: New built-in dataset (uci_electricity) (#3795) 
* add electricity load

* add ut and change doc description

* rename uci_electricity

* rename function
 2021-12-28 15:57:29 +08:00
joan726
4218f11379 Branch docs (#3677) 
Co-authored-by: Kai Huang <huangkaivision@gmail.com>
 2021-12-23 15:46:53 +08:00
Song Jiaming
a677feaf60 Update serving-quickstart.md 2021-12-23 10:31:12 +08:00
dding3
029216909d expose getModel in pynnmodel (#3778) 2021-12-22 18:27:17 +08:00
dding3
862c530685 add get model in nnframe doc (#3776) 
* add get model in nnframe doc
 2021-12-22 15:38:18 +08:00
Song Jiaming
f27f2e9d3a PPML VFL evaluation and predict support (#3714) 2021-12-21 14:30:12 +08:00