Commit graph

12 commits

Author SHA1 Message Date
Yuwen Hu
6960c87b54 [Nano] Revise outdated info in PyTorch Inference how-to guides (#7453)
* Change order of PyTorch Inference how-to guides order

* Revise accelerate_pytorch_inference_jit_ipex.ipynb

* Revise accelerat_pytorch_inference_onnx.ipynb

* Revise accelerate_pytorch_inference_openvino.ipynb

* Revise inference_optimizer_optimize.ipynb

* Revise multi_instance_pytorch_inference.ipynb

* Revise pytorch_context_manager.ipynb

* Revise pytorch_save_and_load_ipex.ipynb and other small fixes

* Revise pytorch_save_and_load_jit.ipynb and other small fixes

* Revise pytorch_save_and_load_onnx.ipynb and other small fixese

* Revise pytorch_save_and_load_openvino.ipynb

* Revise quantize_pytorch_inference_inc.ipynb and other small fixes

* Revise quantize_pytorch_inference_pot.ipynb and other small fixes

* Fix failed links in the index page

* Small fixes

* Update based on comments
2023-02-09 17:50:50 +08:00
Yuwen Hu
c31136df0b [Nano] Improve How-to Guides Navigations (#7396)
* Remove deprecated option enable_auto_doc_ref for recommonmark

* Add first level navigation structure for Nano how-to guides

* Update navigation for How-to Training part

* Update navigation for How-to Inference part

* Update navigation for How-to Preprocessing/Install part and other small fixes

* Fix wrong link path caused by position changes of how-to install related guides

* Small fix
2023-02-03 09:37:10 +08:00
Yuwen Hu
c7674f52b2 [Nano] Add how-to guide for TensorFlow Keras inference using bf16 mixed precision (#7337)
* Add basic structure for tf bf16 infer how-to guide

* Add how-to use BFloat16 mixed precision for TensorFlow Keras inference

* Small fixes

* Add instruction requires box

* Add outputs to show inference time diff

* Small fixes regarding hardware requirements and others

* Update based on comments

* Small fixes

* Small fixes
2023-02-01 13:33:54 +08:00
Sirui Tao
3543a58723 [Nano] How-to Guide: Inference via Openvino on Intel GPUs (#7212)
* add openvino gpu inference guide

* enable online doc for how-to

* fix

* fix layout error

* update w.r.t. comments

* fix

* fix

* fix error
2023-01-12 09:31:12 +08:00
Henry Ma
2858a1b5bf [Nano] Add how-to-guide of load/save API for tensorflow inference (#7180)
* feat(docs): add load/save onnx and opnevino model for tensorflow

* fix bugs after previewing

* fix order issues of insertion for toc.yml

* change link title for tensorflow
2023-01-10 20:15:49 +08:00
Henry Ma
18ae409b7c [Nano] add how-to-guide for tensorflow inference by onnxruntime and openvino (#7149)
* Feat(docs): add how-to-guide for tensorflow inference by onnxruntime and openvino

* fix bugs for index.rst

* revise according to PR comments

* revise minor parts according to PR comments

* revise bugs  according to PR comments
2023-01-04 23:43:48 +08:00
Ruonan Wang
b3feb53c4a Nano: add key feature and how to guide for context manager (#6897)
* add key feature and how to guide for context manager

* update key feature for multi models

* update based on comment

* update

* update based on comments

* update

* update
2022-12-13 16:57:52 +08:00
Yishuo Wang
664dfbe7ef Nano: Add key feature and how to guide for multi-instance inference (#6901) 2022-12-13 14:18:26 +08:00
WangJun
bf5ccae4ef [Nano] add how to guide save and load jit, ipex, onnx, openvino (#6659)
* add how to guide:
* acclerate with jit_ipex
* save and load jit, ipex, onnx, openvino
* add these five above .nblink files
;

* add index of sl files

* clear all the output & fix the bug of title

* remove extra blank indent

* format the jupter with prettier

* fix the bug of error words

* add blank line before unorder list

* * remove the normal inference in accelerate using jit/ipex;
* add note to example why we should pass in the orginal model to get the optimized one in sl ipex

* fix:new pip install shell cmd  & indent improve
2022-11-25 15:47:15 +08:00
Hu, Zhaojie
607db04ad7 [Nano] Openvino model inference notebook example with Nano (#5745)
* add nano notebook example for openvino ir

* add basic example for openvino model inference

* add notebook example for sync inference and async inference

* add notebook to documentation

* update explanation for async api

* try to fix code snip

* fix code snip

* simplify async api explanation

* simplify async api explanation

* adapt new theme
2022-11-16 10:10:07 +08:00
Hu, Zhaojie
a0fa1694b5 [Nano] : Add howto guides for InferenceOptimizer.optimize (#6136)
* howto guide for InferenceOptimizer

* fix format in notebook

* rename notebook & add github workflow

* fix doc issue

* fix notebook

* fix typo

* remove ipykernel

* update notebook

* adapt new theme

* fix typo & remove necessary numpy
2022-10-22 10:44:50 +08:00
Yuwen Hu
12c12a1058 [Nano] How-To Guides: Training - PyTorch Lightning (#5643)
* Rearrange file structure for PyTorch Inference for docs and add titles for PyTorch-Lightning Training

* Add How-to guide: How to accelerate a PyTorch-Lightning application on training workloads through Intel® Extension for PyTorch*

* Add how-to guide: How to accelerate a PyTorch-Lightning application on training workloads through multiple instances

* Revise: remove '-' in 'PyTorch-Lightning' and some other changes

* Add How-to guides: How to use the channels last memory format in your PyTorch Lightning application for training

* Add how-to guide: Use BFloat16 Mixed Precision for PyTorch Lightning Training

* Add How-to guide: How to accelerate a computer vision data processing pipeline

* Small Revision: change comments in several code cells

* Disable other nano tests temporarily

* Add github action tests for Nano Training PyTorch Lightning tests

* Enable other nano tests again

* Small revisions: typos and explanation texts changes

* Revise: update based on comments
2022-09-15 15:26:11 +08:00