ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
750 commits 1 branch 0 tags 37 MiB
Commit graph

246 commits

Author SHA1 Message Date
Ruonan Wang
3df26cc9ed Chronos : add [how to tune a forecaster model] notebook (#5399) 
* add how_to_tune_a_forecaster_model notebook

* modify step1: data preparation

* update based how to train

* modify a bug of summary

* update based on comment

* move to howto

* fix typo

* add file

* update based on comments

* rename the tile
 2022-08-30 22:24:49 +08:00
Cengguang Zhang
57d45e5deb Orca: add save and load model doc to PyTorch Estimator quick-start. (#5504) 
* feat: add save and load model doc to pytorch estimator quickstart.

* fix: fix typo.

* fix: fix typo

* fix: fix typo.

* feat: add doc to ray backend quickstart

* fix: fix typo.

* feat: add doc to ray backend quickstart
 2022-08-24 13:48:32 +08:00
Juntao_Luo
584ee6045c Chronos: update js, css and md files to add filter function in tutorial page. (#5506) 2022-08-23 12:50:29 +08:00
Cengguang Zhang
c94e934068 Orca: update known-issues. (#5505) 
* fix: update known-issues.

* fix: fix wording.
 2022-08-23 11:21:37 +08:00
Yuwen Hu
cc540d0c34 Update "Open in Colab" button in notebooks (#5452) 
* Update open in colab button from HTML-style hyperlinks to markdown image with link for notebooks in readthedocs folder

* Update "Open in Colab" button for notebooks under python folder with markdown image with link
 2022-08-18 14:55:20 +08:00
Yishuo Wang
e62b8d1fc5 Automatically unwrap attributes access of _LiteModule (#5392) 
* automatically unwrap attributes access of _LiteModule and add test for it
* delete redundant documents
 2022-08-18 10:57:52 +08:00
Qiyuan Gong
df75c72d91 Add Key generation suggestion into document (#5446) 
* Add SSL and AES Key generation suggestion into document.
 2022-08-17 22:55:53 +08:00
Chaselzxy
b11496db60 Chronos: How-to-Guides (How to train forecaster on single node) (#5224) 
* how to train forecaster

* add a notebook

* add new notebook

* add index

* fix colab link

* change content

Co-authored-by: Xinyi Zhang <xinyi1.zhang@intel.com>
Co-authored-by: theaperdeng <theaperdeng@outlook.com>
 2022-08-17 20:11:24 +08:00
Cengguang Zhang
241b0f1712 Docs: fix typo and quickstart code branch. (#5414) 2022-08-16 16:20:46 +08:00
Cengguang Zhang
6af23499e7 Docs: add save and load model docs. (#5397) 
* docs: add save and load model docs.

* fix: update code style.

* fix: update code style.

* fix: fix typo and modify wording.

* docs: add save model example to notebook.

* fix: fix typo.
 2022-08-16 15:23:30 +08:00
shaojie
611c9aefdf fix Notebook issues (#5344) 
* fix Notebook issues

* update start-notebook scripts to add token and port parameter.

* update start notebook scripts

* test start notebook scripts and deployment yaml file

* update image tag to latest

* update deployment file,README and start-notebook script file

* update README

* update README

Co-authored-by: baishaojie <shaojiex.bai@intel.com>
 2022-08-16 10:39:39 +08:00
Jason Dai
bdce772965 Update powered-by.md 2022-08-16 07:12:36 +08:00
Cengguang Zhang
2c0424e964 Docs: update orca known issues (#5395) 
* docs: update known issues

* fix: add example to known issue

* fix: add example to known issue

* fix: fix typo

* fix: modify issue description.

* fix: fix typo.

* fix: fix typo.
 2022-08-15 18:20:45 +08:00
Jiao Wang
a440a05b0c Azure PPML doc update (#5386) 
* update

* update
 2022-08-12 15:44:33 -07:00
Song Jiaming
362674ee1c Add a ssl/tls section of Secure Your Devices README (#5366) 
* Add a ssl/tls section of Secure Your Devices README
 2022-08-12 10:07:16 +08:00
Juntao_Luo
dfb0946075 Chronos: Update Chronos install guide form's js and css file. (#5360) 
* Update chronos_installation_guide.css

* Update chronos_installation_guide.js

* Update chronos.md

* Change border color

* Deleted test text in '2. Install' title

I changed the title in last commit to check if my build in readthedoc web works fine. Now I delete it.

* Update button css selector

Revised the button selector to avoid influencing other buttons' style on the web.

* Update #cmd height

* Update as pull-request comment required.

1, disable other options when users choose windows, and guide users to https://bigdl.readthedocs.io/en/latest/doc/Chronos/Overview/windows_guide.html in "Install CMD"
2, guide users to https://bigdl.readthedocs.io/en/latest/doc/Chronos/Overview/chronos.html#tensorflow-backend in "Install CMD" when tensorflow is chosen.
3, guide users to https://github.com/intel-analytics/BigDL/tree/main/docker/chronos-nightly in "install CMD" when docker is chosen.

* Update css file to meet the comment requirements

Make the disabled items' background darker to have a better vis experience. 
Have a larger fontsize.

* Update js file to meet the comment requirement.

 Make the disabled items' background darker to have a better vis experience.

* Update border css settings.

Changed table border settings since last version looks not good.

* Change pmdarima to ARIMA

* Update visuals.

The button now has a hovering style, indicating the user that it can be clicked.
 2022-08-11 17:30:03 +08:00
Jiao Wang
c8dd8d6e5e update (#5362) 2022-08-10 12:56:41 -07:00
Yishuo Wang
19e6099483 supplement the doc of torchnano (#5348) 2022-08-10 09:54:56 +08:00
Junwei Deng
b2dac661db Chronos: add quick tour page (#5217) 
* add quick tour

* update some md

* update quick tour

* add some contents

* add some changes

* change link

* add new file

* fix some typo

* fix typo

* fix typo

* fix typo

* fix typo

* fix typos

* fix bug

* fix typos

* fix typos

* fix bug

* fix bug

* fix bug

* fix bug

* add information

* fix type

* add description

* add more content

* add some bug fix

* update document

* update

* update page

* fix typo

* update typos

* fix typo
 2022-08-09 12:16:38 +08:00
David smurf
99bef5579d Chronos: XShardsTSDataset user guide (will be reused in how-to handle large data) (#5196) 
* new xshards_doc

* update

* update

* update

* update

* update

* update

* update

* udpate xshardstsdataset doc

* fix typos

* fix some typos

Co-authored-by: theaperdeng <theaperdeng@outlook.com>
 2022-08-09 09:53:00 +08:00
Mingzhi Hu
5506f60732 Nano: Add TensorFlow step by step tutorials (#5156) 
* Add tutorial notebook

* Add md

* Test on readthedocs

* Fix markdown

* fix md

* update notebooks

* update requirements version in doc

* update

* add and update tutorial

* add unit test for tensorflow tutorial

* reduce test time

* reduce test time

* update shell

* update action

* Update tutorial

* reduce ut time

* reduce ut time

* reduce ut time

* reduce ut time

* reduce ut time

* Update

* Fix shell

* update

* update

* rollback requirements

* Update

* Update

Co-authored-by: pinggao187 <ping.gao3@pactera.com>
 2022-08-09 09:03:45 +08:00
Cengguang Zhang
985aec4425 Orca: add grpc error to orca known issues (#5309) 
* feat: add grpc error to orca known issues

* refactor: update short name and style.

* refactor: refine error explanation

* Update known_issues.md

* Update known_issues.md
 2022-08-08 18:10:29 +08:00
Ziyao Peng
41f602fcec Chronos: Add a page 'Windows User Guide.md' to ReadTheDocs (#5263) 
* Add files via upload

* Update _toc.yml

* Update windows_guide.md

* r

* Delete windows_guide.html
 2022-08-08 17:41:29 +08:00
Ruonan Wang
f682f79166 Chronos : add multi-objective HPO with latency tutorial (#5307) 
* add mo hpo with latency tutorial

* update according to comment

* remove test_data

* add license
 2022-08-08 14:28:29 +08:00
Junwei Deng
9dbe743ea4 Chronos: add more installation options (#5175) 
* add installation options

* add new tested setup.py and quickstart changes

* add installation guide

* add some doc fix

* chronos typo

* fix typos

* fix pep8

* fix accord comments
 2022-08-05 14:11:48 +08:00
Yuwen Hu
7ef605b58f [Nano] Correct typos in ReadtheDocs (#5250) 
* Correct typos for Nano User Guide page

* Correct typos for BigDL-Nano PyTorch Training Overview page

* Correct typos for BigDL-Nano PyTorch Inference Overview page

* Correct typos for BigDL-Nano PyTorch ONNXRuntime Acceleration Quickstart page

* Correct typos for Windows User Guide page

* Correct typos for BigDL-Nano TensorFlow Training Overview page

* Correct typos for BigDL-Nano TensorFlow Inference Overview page

* Small fix based on Shengsheng's comments

* Fix based on Wang, Yang's comments
 2022-08-03 10:37:08 +08:00
Kai Huang
70b2070e4d Update Python User Guide (#5275) 
* add doc

* fix
 2022-08-02 12:24:52 +08:00
Yishuo Wang
0f78a568c7 add tutorial, notebook and API doc for LightningLite (#5114) 
* add tutorial, notebook and API doc for LightningLite
* increase the timeout when running tutorial notebook
* change docs and tutorial to use new API
 2022-08-02 09:15:50 +08:00
Kai Huang
cda8967416 Fix libhdfs known issue doc (#5257) 
* fix doc

* minor
 2022-08-01 20:28:36 +08:00
joan726
df2a7dcef0 Update powered-by.md (#5261) 2022-08-01 15:03:48 +08:00
Yuwen Hu
a4bbadeb61 [Nano] Integrate ipynb files into ReadtheDocs (#5222) 
* Add nbsphinx extension for docs

* Add specific ipynb files to readthedocs folder and add links to Nano Tutorials index page

* Disable execution of ipynb notebook

* Remove outputs of two ipynb files

* Rename titles and add navigation texts to seq_and_func.ipynb under readthedocs folder

* Rename titles and add navigation texts to custom.ipynb file under readthedocs folder
 2022-08-01 13:06:03 +08:00
Cengguang Zhang
50c180520e Docs: Bigdl known issues docs (#5204) 
* docs: add dynamic allocation to FAQ/known issues in docs

* style: reformat the code

* docs: add known_issues to _toc.yml

* docs: remove known-issues.md

* fix: delete unnecessary issues

* fix: refine known_issue format and add barrier mode configuration.

* fix: reformat known_issues.md

* fix: update known_issues.md

* fix: modify known_issues.md

* fix: amend the wording
 2022-07-28 16:18:18 +08:00
Jiao Wang
f5909aee9f Update Azure PPML docs (#5163) 
* update doc

* update

* update

* update
 2022-07-25 12:59:34 -07:00
Zhao Changmin
d120db025e Mirgate Terminal Setup Steps into Developer Guide (#5133) 
* correct prepare_env.sh path

* Alternative way to prepare envs
 2022-07-25 15:35:00 +08:00
Yuwen Hu
a44571f8a3 Chronos: Correct typo for Chronos User Guide (#5166) 2022-07-22 14:49:43 +08:00
obarut
7232f23176 Chronos: installation user guide typo (#4915) 
* avoid installation of python 3.7.0 and typo

python 3.7.0 and 3.7.1 is problematic with Ray (happens while orca context being init.)

* go back to py 3.7

if base conda env is not py 3.7.0 or 3.7.1, then no pb.
 2022-07-12 19:57:30 +08:00
plusbang
fa3c7f8aff chronos: user guide python version note change (#5067) 
Co-authored-by: binbin <binbin1.deng@intel.com>
 2022-07-11 17:10:19 +08:00
Shaojun Liu
98f1b7a406 [ppml] add ppml cli into docker image (#5056) 
* add bigdl-ppml-submit.sh into ppml graphene image

* remove ppml-spark-submit.sh since it was replaced by bigdl-ppml-submit.sh

* update ppml-spark-submit.sh to bigdl-ppml-submit.sh
 2022-07-08 17:09:47 +08:00
Yang Wang
01e6c62a68 Fix typo in nano documentation (#5036) 2022-07-07 09:43:10 +08:00
Mingzhi Hu
2157af9a03 Add rst (#5027) 2022-07-06 14:21:11 +08:00
Junwei Deng
d904070154 Chronos: fix some api document tag (#5017) 2022-07-05 10:41:11 +08:00
Shane Huang
16005ada17 add hpo tutorial (#5011) 2022-07-04 17:23:33 +08:00
Shane Huang
53ba2d8279 fix docs (#5009) 
* fix docs

* add resources
 2022-07-04 16:59:10 +08:00
Shane Huang
3f576e5ffa Nano docs: add hpo api docs (#4901) 
fix hpo api docs
 2022-07-04 14:37:13 +08:00
Qiyuan Gong
501505af0d [PPML] Fix typo in link (#5005) 
* trusted_big_bata_analytics_and_ml.md -> trusted_big_data_analytics_and_ml.md
 2022-07-04 13:02:09 +08:00
Qiyuan Gong
df6dfc6a22 Application security doc (#5001) 
* Data lifecycle
* HDFS Security
* Spark Security
* K8S Security
 2022-07-04 11:16:29 +08:00
Mingzhi Hu
798345123f Nano: Update Nano PyTorch quick start doc (#4897) 
* add BigDL-Nano PyTorch Quickstart

* Update BigDL-Nano PyTorch Quickstart

* Update BigDL-Nano PyTorch Quickstart

* Add Nano inference quickstart
- add inference onnx quickstart
- add inference openvino quickstart
- add quantization inc quickstart
- add quantization inc onnx quickstart
- add quantization openvino quickstart

* update quickstart

* update quickstart

* Add Nano quantization quickstart

* update nano docs

* Update docs

* Update Nano OpenVINO tutorial

* Update

* Update index.md

* Resize Images

* Resize Images

* Update

* Update Nano docs

* Update nano documents

* Update doc & notebook

* clear output of cells

* add unit tests for tutorial notebooks

* fix errors in yaml

* fix error in notebook

* reduce quantization time

* Update yaml

* Add unit test for tutorial

* Add tests for tutorial

* fix shell
 2022-07-04 10:10:21 +08:00
Shane Huang
a6cab83afd revise Chronos api doc (#4993) 2022-07-01 18:19:46 +08:00
Shane Huang
41a28c317f update visualization docs (#4980) 
* update docs
 2022-06-30 23:08:12 +08:00
Le-Zheng
cef5359c54 update tpch doc (#4979) 2022-06-30 12:59:31 +08:00
Junwei Deng
26ec59edf7 Chronos: add autoformer example on electricity and api doc (#4950) 
* add autoformer example and api doc

* update license and readme
 2022-06-28 17:37:20 +08:00
Song Jiaming
18a9c2f57a PPML FGBoost tutorial draft (#4751) 2022-06-27 15:46:52 +08:00
David smurf
500b7bbe99 Chronos: add tf forecaster doc (#4923) 2022-06-27 11:33:41 +08:00
Junwei Deng
76608a5034 Orca: add dashboard.log error in known issue (#4943) 
* add dashboard.log error

* add title

* typo fix
 2022-06-27 11:10:24 +08:00
Shan Yu
86fa1c02ab Rename Orca Tensorflow Estimator backend name from "tf2" to "ray" (#4938) 
* rename backend name from tf2 to ray

* rename in doc

* rename in docstring

* manually

* rename test_tf2estimator_tf2_backend.py -> test_tf2estimator_ray_backend.py

* change tf2 in multi_agent_two_trainers.py back
 2022-06-27 08:40:33 +08:00
Shan Yu
8f51ed4cf1 Add Orca Known issues (#4940) 2022-06-24 16:45:41 +08:00
Mingzhi Hu
145216bfc1 Update pytorch to 1.11 (#4854) 
* update setup and action

* fix yml

* update yml

* test yml

* update docs

* update notebook requirements

* test notebooks unit test

* reset yml

* delete comments

* fix yml

* fix errors in setup.py

* fix setup.py

* specify the version of IPEX
 2022-06-24 16:38:48 +08:00
Rebekk
8e10bdeabd Chronos: add Evaluator doc (#4889) 
* add evaluator doc

* add index
 2022-06-21 09:47:25 +08:00
Zhentao Chen
7dcd79366f doc fix (#4829) 2022-06-15 08:23:01 +08:00
Nancy
04542bc6db Fix code style in PyTorch QuickStart (#4821) 
* fix two issues

* fix two issues
 2022-06-14 09:58:43 +08:00
Zhentao Chen
e7c7ab2b8e [Nano] add tf inference doc (#4797) 
* add tf inference doc

* fix doc

* grammarly check

* add sequential
 2022-06-13 08:54:48 +08:00
jenniew
f687e4b684 Update Azure PPML doc (#4809) 
* add script

* update

* update

* update scripts and doc

* update pass

* update

* update docker

* update

* aks script

* update create aks

* add doc

* update

* vm size note
 2022-06-12 17:22:43 -07:00
jenniew
6aeabae58b Azure PPML support (#4660) 
* add script

* update

* update

* update scripts and doc

* update pass

* update

* update docker

* update

* aks script

* update create aks

* add doc

* update
 2022-06-12 17:06:24 -07:00
Mingzhi Hu
2c4623f8da Update pytorch_train.md (#4786) 
* Update pytorch_train.md

Add description about torchvision version

* Update pytorch_train.md
 2022-06-09 08:39:44 +08:00
Yang Wang
20ad708010 Add Nano PyTorch API Doc (#4730) 
* add trainer api doc

* add index and fix trainer

* fix doc

* reset

* fix conflict

* fix import
 2022-06-08 17:45:24 +08:00
jenniew
e150593602 Azure PPML documentation (#4675) 
* az doc

* update

* update
 2022-06-07 08:20:24 -07:00
Zhentao Chen
900711f1b3 [Nano] add pytorch inference doc (#4656) 
* pytorch inference doc init commit

* quantization with tuning

* fix grammarly

* remove val_dataloader

* specify version
 2022-06-02 14:42:00 +08:00
Shane Huang
8ced71c488 revise hpo doc (#4735) 2022-05-31 17:35:52 +08:00
Shane Huang
e24859c39b add resume and parallel search docs (#4734) 2022-05-31 17:08:23 +08:00
liangs6212
0af87a18c6 Chronos: Fix readthedocs.io build error (#4720) 
* add pickle5 version

* fix doc issue

* fix import bigdl.nano in doc

* renamed basepytorchmodel to baseautomodel

* renamed again
 2022-05-30 17:52:20 +08:00
Shan Yu
5bc293b9c5 Update Chronos installation guide (#4698) 2022-05-26 10:20:33 +08:00
Le-Zheng
db2818c8f7 update databrciks doc (#4691) 2022-05-26 07:41:44 +08:00
Yang Wang
55fa3e13e6 Add Nano Known issues and some notebook link (#4667) 
* Add Nano Known issues and some notebook link

* fix typo
 2022-05-25 10:26:46 +08:00
Shane Huang
353e7ffbdf [Nano HPO] revised user guide (#4666) 
* revise doc

* revise doc

* revise docs again
 2022-05-24 14:42:42 +08:00
Shane Huang
993c80b427 [Nano HPO] user guide (#4639) 
* add initial version of hpo doc

* modify the doc index

* revised doc

* revise docs

* revise docs
 2022-05-23 21:33:27 +08:00
Yang Wang
4ab95fa3e4 Fix Nano TensorFlow Doc Link (#4634) 2022-05-19 09:30:30 +08:00
Yang Wang
aabeb3fe35 add nano documentation pages to readthedocs site (#4619) 
* add nano documentation pages to readthedocs site

* fix file name

* refine title

* fix typo
 2022-05-18 09:22:02 +08:00
Yang Wang
210677a295 Add nano documentation for pytorch training quickstart (#4577) 
* Add nano documentation for pytorch training quickstart

* fix some typo

* break pytorch training and inference to two files

* simplify trainer import

* fix train doc
 2022-05-16 14:14:30 +08:00
Yang Wang
25982b0d16 Add Nano TensorFlow Training QuickStart Doc (#4591) 
* Add Nano TensorFlow Training QuickStart Doc

* fix typo

* break training and inference to two files
 2022-05-16 10:46:16 +08:00
Yang Wang
0656804f56 Add windows guide to nano overview (#4599) 
* Add windows guide to nano overview

* add source cmmd
 2022-05-16 10:45:12 +08:00
Rebekk
cc2499aa44 Chronos: add chronos known issue (#4496) 
* add chronos known issue

* modify doc

* modify chronos_known_issue

* modify chronos issue

* modify

* modify issue

* modify chronos_known_issus
 2022-05-13 15:11:31 +08:00
dding3
05f6fd24b4 add error handling api guidance (#4557) 
* add error handling api guidance
 2022-05-09 09:34:31 -07:00
Yang Wang
fd1da60251 Add Nano doc structure and Nano overview (#4504) 
* Add Nano doc structrue and nano overview

* add sections

* add unset environment variable instructions

* restructure

* address comments
 2022-05-09 17:12:44 +08:00
Jason Dai
24cf032a91 Update powered-by.md 2022-04-28 11:07:07 +08:00
Xiaohang Fu
359d5a6989 [PPML] Update readthedoc of PPML (#4515) 
* Change standalone to k8s
* Update the doc
 2022-04-27 13:47:51 +08:00
Junwei Deng
ada7b4b978 Chronos: document regular update (#4241) 
* add information changes

* update typos

* add typo changes

* update documents

* update chronos.md

* add updates

* fix rst

* add speed-up md

* fix broken links and typos, add tutorials
 2022-04-24 15:55:23 +08:00
Xiaohang Fu
96fa40b4f7 [PPML] Update the document of TPC-DS (#4447) 
* Update the document of TPC-DS
* Update style
 2022-04-19 16:10:24 +08:00
Xiaohang Fu
154f32ce97 [PPML] Modify the quickstart document of TPC-DS (#4441) 
* Change command order
* [PPML]Modify the quickstart document of tpc-ds
* Remove blank
 2022-04-19 09:56:05 +08:00
Le-Zheng
56aee11c82 fix version in docs (k8s/scala) (#4440) 
* fix version in docs (k8s/scala)

* update
 2022-04-18 16:26:44 -07:00
Qiyuan Gong
0e0fbaf3d6 [PPML] Readthedoc fix path and branch (#4431) 
* scala/docker-graphene to python/docker-graphene
* Branch 2.0 to main
 2022-04-18 19:41:47 +08:00
CharleneHu94
658a4286f2 [PPML] Update trusted-big-data graphene doc (#4434) 
* update trusted-big-data graphene doc

* Update tpc-h_with_sparksql_on_k8s.md
 2022-04-18 16:09:09 +08:00
Forest
793306c275 [PPML] Add TPC-DS QuickStart document (#4430) 
* [ppml] Add TPC-DS QuickStart document
* Modify index.rst
* Change command order
 2022-04-18 14:42:00 +08:00
Shan Yu
71cd125837 Rename backend name from “torch_distributed” to “ray” in Orca Pytorch Estimator (#4388) 
* change backend name from torch_distributed to ray

* update in examples and docs
 2022-04-12 09:29:21 +08:00
Kai Huang
0c0e99fee5 Fix spark-submit scripts and doc (#4344) 
* fix yarn client

* fix shell script

* revert sh

* revert

* update doc

* finish doc update

* fix

* minor
 2022-04-06 19:27:43 +08:00
liangs6212
39f7fd2d1f Chronos: migrate from tf1.15 to tf2 (MTNetForecaster) (#4334) 
* convert mtnet_forecaster

* fix conflict

* add batch_size

* fix conflict

* change description

* change description again

* fix doc

* change param description
 2022-04-06 14:55:55 +08:00
SONG Ge
23aa10345f [Orca] Update Documents for Tf2estimator on Pyspark Backend (#4308) 
* update tf2estimator on pyspark backend docs
 2022-03-31 09:49:56 +08:00
SONG Ge
5d4743a12a [Orca] Update Orca Python API Docs (#4327) 
* update orca api docs
 2022-03-30 16:48:39 +08:00
Qiyuan Gong
6309dbd16b [PPML] Upgrade Kernel version to 5.14 in build from kernel (#4255) 
* Upgrade Kernel version to 5.14 in build from kernel
* Add 5.13 nfs issue
 2022-03-16 17:08:32 +08:00
Qiyuan Gong
93ea53e1e4 [PPML]Upgrade PPML image version to 2.1.0-SNAPSHOT in readthedoc (#4253) 
* Upgrade PPML image version to 2.1.0-SNAPSHOT in readthedoc
 2022-03-16 16:02:12 +08:00
Heyang Sun
d473177599 [PPML] Update graphene version number on main branch (#4250) 
* Update graphene version number on main branch
 2022-03-15 16:45:29 +08:00