From 607db04ad78dcaab1e83a18fbfcabbf49640dd92 Mon Sep 17 00:00:00 2001 From: "Hu, Zhaojie" Date: Wed, 16 Nov 2022 10:10:07 +0800 Subject: [PATCH] [Nano] Openvino model inference notebook example with Nano (#5745) * add nano notebook example for openvino ir * add basic example for openvino model inference * add notebook example for sync inference and async inference * add notebook to documentation * update explanation for async api * try to fix code snip * fix code snip * simplify async api explanation * simplify async api explanation * adapt new theme --- .../Inference/OpenVINO/openvino_inference.nblink | 3 +++ .../OpenVINO/openvino_inference_async.nblink | 3 +++ docs/readthedocs/source/doc/Nano/Howto/index.rst | 13 +++++++++++++ 3 files changed, 19 insertions(+) create mode 100644 docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/openvino_inference.nblink create mode 100644 docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/openvino_inference_async.nblink diff --git a/docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/openvino_inference.nblink b/docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/openvino_inference.nblink new file mode 100644 index 00000000..c3d9c786 --- /dev/null +++ b/docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/openvino_inference.nblink @@ -0,0 +1,3 @@ +{ + "path": "../../../../../../../../python/nano/tutorial/notebook/inference/openvino/openvino_inference.ipynb" +} \ No newline at end of file diff --git a/docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/openvino_inference_async.nblink b/docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/openvino_inference_async.nblink new file mode 100644 index 00000000..883bb4f8 --- /dev/null +++ b/docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/openvino_inference_async.nblink @@ -0,0 +1,3 @@ +{ + "path": "../../../../../../../../python/nano/tutorial/notebook/inference/openvino/openvino_inference_async.ipynb" +} \ No newline at end of file diff --git a/docs/readthedocs/source/doc/Nano/Howto/index.rst b/docs/readthedocs/source/doc/Nano/Howto/index.rst index e47e4a08..7d542dac 100644 --- a/docs/readthedocs/source/doc/Nano/Howto/index.rst +++ b/docs/readthedocs/source/doc/Nano/Howto/index.rst @@ -31,6 +31,19 @@ General Inference Optimization ------------------------- +OpenVINO +~~~~~~~~~~~~~~~~~~~~~~~~~ + +* `How to run inference on OpenVINO model `_ +* `How to run asynchronous inference on OpenVINO model `_ + +.. toctree:: + :maxdepth: 1 + :hidden: + + Inference/OpenVINO/openvino_inference + Inference/OpenVINO/openvino_inference_async + PyTorch ~~~~~~~~~~~~~~~~~~~~~~~~~