Commit graph

87 commits

Author SHA1 Message Date
Yishuo Wang
48f5144a34 Nano: remove inc from [inference] option on windows (#7664) 2023-02-23 16:30:08 +08:00
Yuwen Hu
d4c46a011c [Nano] Update installation panel to include stock TensorFlow (#7622)
* Update installation panel for Nano to include stock TensorFlow

* Update nano installation table styles

* Fix selector which is too wide, and other small fixes
2023-02-22 17:55:03 +08:00
Yang Wang
0e31d15f6d Restructure pytorch inference documentation (#7608)
Co-authored-by: yang3.wang@intel.com <Yang Wang>
2023-02-17 14:28:36 -08:00
binbin Deng
8a8fe7ff9f Chronos: upgrade torch to 1.13.1 and add description about onnx in troubleshooting page (#7523) 2023-02-17 09:27:00 +08:00
Yishuo Wang
13568a9aa8 Nano: fix multi-instance on Windows (#7493) 2023-02-10 18:05:18 +08:00
Yuwen Hu
6960c87b54 [Nano] Revise outdated info in PyTorch Inference how-to guides (#7453)
* Change order of PyTorch Inference how-to guides order

* Revise accelerate_pytorch_inference_jit_ipex.ipynb

* Revise accelerat_pytorch_inference_onnx.ipynb

* Revise accelerate_pytorch_inference_openvino.ipynb

* Revise inference_optimizer_optimize.ipynb

* Revise multi_instance_pytorch_inference.ipynb

* Revise pytorch_context_manager.ipynb

* Revise pytorch_save_and_load_ipex.ipynb and other small fixes

* Revise pytorch_save_and_load_jit.ipynb and other small fixes

* Revise pytorch_save_and_load_onnx.ipynb and other small fixese

* Revise pytorch_save_and_load_openvino.ipynb

* Revise quantize_pytorch_inference_inc.ipynb and other small fixes

* Revise quantize_pytorch_inference_pot.ipynb and other small fixes

* Fix failed links in the index page

* Small fixes

* Update based on comments
2023-02-09 17:50:50 +08:00
Yishuo Wang
56d699d935 Nano: update os support (#7491) 2023-02-09 15:48:30 +08:00
Yuwen Hu
9c129ec158 [Nano] Revise PyTorch Inference key feature doc regarding context manager (#7449)
* Revise PyTorch Inference key feature doc regarding context manager

* Small fixes and revise the installation notes

* Small fix

* Update based on comments

* Update based on comments
2023-02-08 17:26:08 +08:00
Yishuo Wang
f4700422e1 Nano: add OS support table (#7429) 2023-02-06 18:01:31 +08:00
Ruonan Wang
06e6935ba9 Nano: update troubleshooting guide (#7285)
* update troubshooting guide

* update based on comment
2023-02-03 17:29:58 +08:00
Yang Wang
f903b78711 restructure tensorflow inference document (#7417) 2023-02-02 18:14:02 -08:00
Yuwen Hu
c31136df0b [Nano] Improve How-to Guides Navigations (#7396)
* Remove deprecated option enable_auto_doc_ref for recommonmark

* Add first level navigation structure for Nano how-to guides

* Update navigation for How-to Training part

* Update navigation for How-to Inference part

* Update navigation for How-to Preprocessing/Install part and other small fixes

* Fix wrong link path caused by position changes of how-to install related guides

* Small fix
2023-02-03 09:37:10 +08:00
Yuwen Hu
c7674f52b2 [Nano] Add how-to guide for TensorFlow Keras inference using bf16 mixed precision (#7337)
* Add basic structure for tf bf16 infer how-to guide

* Add how-to use BFloat16 mixed precision for TensorFlow Keras inference

* Small fixes

* Add instruction requires box

* Add outputs to show inference time diff

* Small fixes regarding hardware requirements and others

* Update based on comments

* Small fixes

* Small fixes
2023-02-01 13:33:54 +08:00
Junwei Deng
90c76ce7a2 Nano: Add some user guide and warning messages according to feedback (#7374) 2023-02-01 08:53:08 +08:00
Sirui Tao
3543a58723 [Nano] How-to Guide: Inference via Openvino on Intel GPUs (#7212)
* add openvino gpu inference guide

* enable online doc for how-to

* fix

* fix layout error

* update w.r.t. comments

* fix

* fix

* fix error
2023-01-12 09:31:12 +08:00
liangs6212
5ebaa3a41b Nano: Updated the description of “python version” (#7220)
* update versions

* rename
2023-01-11 10:10:55 +08:00
Henry Ma
2858a1b5bf [Nano] Add how-to-guide of load/save API for tensorflow inference (#7180)
* feat(docs): add load/save onnx and opnevino model for tensorflow

* fix bugs after previewing

* fix order issues of insertion for toc.yml

* change link title for tensorflow
2023-01-10 20:15:49 +08:00
Sirui Tao
d950992b91 [Nano] How-To Guides: Accelerate PyTorch Training with IPEX & Multi-instance & BF16 & Channels last (#7035)
* add pytorch training ipex guide

* add pytorch training multi-instance guide

* add bf16 guide

* small changes of presentation

* add channels last guide

* remove validation loader

* hide code block

* update based on comments

* add guide for reference

* update guides w.r.t. comments
2023-01-10 13:14:47 +08:00
Yishuo Wang
c4874f35c8 Nano: Add key feature for keras inference (#6925) 2023-01-09 16:43:15 +08:00
Junwei Deng
1d4d65dd07 Nano: add Neural Coder example and document (#7167)
* add NC example on nano

* update information
2023-01-05 18:13:44 +08:00
Yuwen Hu
5e9ef7b553 [Nano] Add a generalized how-to guide for accelerate PyTorch cv data process pipeline (#7125)
* Restyle blockquote elements in web

* Add a generalized how-to section for preprocessing, including the data process accelerastion for PyTorch

* Small fix

* Update based on comments and small typo fixes

* Small fixes
2023-01-05 18:07:10 +08:00
Yuwen Hu
bfca337d09 [Nano] Add how-to guide for TensorFlow Keras training using bf16 (#7169)
* Add basic doc structure for bf16 tf training how-to guide, and change the incorrect order of tf inference guides in toc

* Add how-to guide for tf bf16 training

* Add warning box for tf bf16 hardware limitations

* Add a print message to show the default policy of model after unpatch

* Small fixes

* Small github action fixes for tf bf16 training how-to guide

* diable action test for tf bf16 train for now, due to the core dumped problem on platforms without AVX512

* Updated based on comments
2023-01-05 17:59:43 +08:00
Henry Ma
18ae409b7c [Nano] add how-to-guide for tensorflow inference by onnxruntime and openvino (#7149)
* Feat(docs): add how-to-guide for tensorflow inference by onnxruntime and openvino

* fix bugs for index.rst

* revise according to PR comments

* revise minor parts according to PR comments

* revise bugs  according to PR comments
2023-01-04 23:43:48 +08:00
Yishuo Wang
ab9a3b69fb Nano: Add CUDA patch key feature (#7089) 2023-01-04 10:53:27 +08:00
Ruonan Wang
925874b2cd Nano: improve Howto guide of InferenceOptimizer.optimize (#6924)
* update howto guide for optimizer

* update export model

* update typo

* update based on comments

* fix bug of get_best_model without validation data

* update ut

* update

* update

* fix 600s

* fix
2023-01-03 14:08:05 +08:00
Henry Ma
614d2ab289 Nano: fix some typos of web documentation (#7113) 2023-01-03 10:28:32 +08:00
Yishuo Wang
6375e36f00 Nano: upgrade openvino to 2022.3.0 and torchmetics to 0.11.0 (#7091) 2022-12-29 17:35:37 +08:00
Yuwen Hu
c66cca0c62 [Nano] Add more key features regarding TorchNano and @nano for PyTorch training (#7072)
* Add more key features regarding TorchNano and @nano for pytorch training

* Small fixes

* Remove the Overview title

* Add auto_lr in related notes

* Update based on comments
2022-12-27 16:52:49 +08:00
liangs6212
da7b30529b Nano: Update the Nano installation panel (#7015)
* update installation panel

* fix typo

* fix typo again

* fix typo

* experimental change

* fix typo

* fix known issues

* update

* update subsections

* update typo

* update according to comment

Co-authored-by: TheaperDeng <theaperdeng@outlook.com>
2022-12-26 15:43:36 +08:00
Yuwen Hu
37b0c6fa50 [Nano] How-To Guides: Convert to TorchNano & use @nano decorator (#5984)
* Add how to guide: How to convert your PyTorch code to use TorchNano for training acceleration

* Small nano how-to index format update for openvino inference

* Update based on comments

* Updated based on comments

* Add how-to guide: How to wrap a PyTorch training loop through @nano decorator

* Add reference to TorchNano guide in @nano guide

* Some small fixes and updates

* Small typo fix: bulit -> built

* Updates based on comments

* Remove validation dataloader based on comments

* Order change of two guides

* Update based on comments
2022-12-26 15:36:53 +08:00
Ruonan Wang
14cf4aff72 Nano: Troubshooting guide for BigDL-Nano (#6910)
* add troubshooting guide

* add more cases

* update style

* update

* update style

* update two cases

* update

* add two issue
2022-12-26 10:02:44 +08:00
Ruonan Wang
935fc48354 Nano: update PyTorch inference key feature doc (#6938)
* upddate installation

* update

* update runtime acceleration

* update link in rst

* add bf16 quantization and optimize()

* update based on comment

* update

* update based on comment
2022-12-22 13:34:18 +08:00
Yishuo Wang
3b6c56b505 Nano: update nano known issue (#7063) 2022-12-22 09:53:05 +08:00
Yishuo Wang
0a62df22aa Nano: quick fix typo (#7064) 2022-12-21 16:31:15 +08:00
Junwei Deng
dea7b8f9f2 Nano: update train pytorch key feature doc (#6906)
* update train doc

* update train page
2022-12-19 15:51:19 +08:00
Ruonan Wang
b3feb53c4a Nano: add key feature and how to guide for context manager (#6897)
* add key feature and how to guide for context manager

* update key feature for multi models

* update based on comment

* update

* update based on comments

* update

* update
2022-12-13 16:57:52 +08:00
Yishuo Wang
664dfbe7ef Nano: Add key feature and how to guide for multi-instance inference (#6901) 2022-12-13 14:18:26 +08:00
Yishuo Wang
7e180d028e Nano: update tensorflow examples (#6935) 2022-12-12 13:56:05 +08:00
Yishuo Wang
7e2742cace Nano: Update examples and tutorials (#6888) 2022-12-08 11:23:48 +08:00
liangs6212
ae7160790d Doc: Nano installation panel (#6852)
* add nano installation panel

* try fix

* try fix again

* fix typo

* add versions

* try fix second

* try fix second again

* fix col width

* rollback

* rollback again

* fix syntax error

* fix syntax error again

* fix syntax error last

* fix syntax

* fix syntax

* fix syntax again

* add some comment

* try fix

* try fix

* try fix again

* try fix

* fix typo

* fix some error

* fix typo

* some optimization

* change width

* change width again

* change width again

* change width again

* last width change

* fix description error

* change inference default to yes

* switch inferenceyes and inferenceno
2022-12-07 14:30:11 +08:00
Junwei Deng
87507ba715 Nano: add partial m-series chip support for tensorflow (training and installation) (#6520)
* add m1 chip support

* fix setup
2022-11-30 13:18:00 +08:00
WangJun
bf5ccae4ef [Nano] add how to guide save and load jit, ipex, onnx, openvino (#6659)
* add how to guide:
* acclerate with jit_ipex
* save and load jit, ipex, onnx, openvino
* add these five above .nblink files
;

* add index of sl files

* clear all the output & fix the bug of title

* remove extra blank indent

* format the jupter with prettier

* fix the bug of error words

* add blank line before unorder list

* * remove the normal inference in accelerate using jit/ipex;
* add note to example why we should pass in the orginal model to get the optimized one in sl ipex

* fix:new pip install shell cmd  & indent improve
2022-11-25 15:47:15 +08:00
Yishuo Wang
62694b420e Nano: fix onnx quantization document issue (#6662) 2022-11-17 15:34:45 +08:00
Hu, Zhaojie
607db04ad7 [Nano] Openvino model inference notebook example with Nano (#5745)
* add nano notebook example for openvino ir

* add basic example for openvino model inference

* add notebook example for sync inference and async inference

* add notebook to documentation

* update explanation for async api

* try to fix code snip

* fix code snip

* simplify async api explanation

* simplify async api explanation

* adapt new theme
2022-11-16 10:10:07 +08:00
Yuwen Hu
89f97fed01 Move in-file toc to yml file except for API related toc (#6273) 2022-10-25 11:00:57 +08:00
Yishuo Wang
6a8cdd71de fix torch_nano document link error and small change (#6257) 2022-10-24 14:04:02 +08:00
Ruonan Wang
f54b9b1915 Nano : update installation guide to nightly-build version (#6203)
* update install.md

* update examples

* update doc based on comments

* update link
2022-10-24 14:01:29 +08:00
Hu, Zhaojie
a0fa1694b5 [Nano] : Add howto guides for InferenceOptimizer.optimize (#6136)
* howto guide for InferenceOptimizer

* fix format in notebook

* rename notebook & add github workflow

* fix doc issue

* fix notebook

* fix typo

* remove ipykernel

* update notebook

* adapt new theme

* fix typo & remove necessary numpy
2022-10-22 10:44:50 +08:00
Yuwen Hu
0407ebf5c3 [Doc] Remove manually-added bold styles for titles (#6215)
* Remove manually-added bold style for titles in [User guide] section

* Fix failed relative links in windows user guide

* Remove manually-added bold style for titles in [Orca] section

* Fix failed relative links & title bold fix in Nano 5 min

* Remove manually-added bold style for titles in [Nano] section

* Remove manually-added bold style for titles in [DLlib] section

* Remove manually-added bold style for titles in [Chronos] section

* Remove manually-added bold style for titles in Developer guide

* Remove manually-added bold title style for all other not-included md files in docs/readthedocs/source/doc folder

* Fix based on comments
2022-10-20 13:48:22 +08:00
Yishuo Wang
7b28b3fd20 Nano: Rename strategy parameter of TorchNano to distributed_backend (#6126) 2022-10-20 09:16:55 +08:00