From 3543a5872372b47b91d6c5fdacd7d5f2c1ac10a2 Mon Sep 17 00:00:00 2001 From: Sirui Tao Date: Thu, 12 Jan 2023 09:31:12 +0800 Subject: [PATCH] [Nano] How-to Guide: Inference via Openvino on Intel GPUs (#7212) * add openvino gpu inference guide * enable online doc for how-to * fix * fix layout error * update w.r.t. comments * fix * fix * fix error --- docs/readthedocs/source/_toc.yml | 1 + .../OpenVINO/accelerate_inference_openvino_gpu.nblink | 3 +++ docs/readthedocs/source/doc/Nano/Howto/index.rst | 1 + 3 files changed, 5 insertions(+) create mode 100644 docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/accelerate_inference_openvino_gpu.nblink diff --git a/docs/readthedocs/source/_toc.yml b/docs/readthedocs/source/_toc.yml index f417e02c..1be9d8f7 100644 --- a/docs/readthedocs/source/_toc.yml +++ b/docs/readthedocs/source/_toc.yml @@ -118,6 +118,7 @@ subtrees: - file: doc/Nano/Howto/Training/General/choose_num_processes_training - file: doc/Nano/Howto/Inference/OpenVINO/openvino_inference - file: doc/Nano/Howto/Inference/OpenVINO/openvino_inference_async + - file: doc/Nano/Howto/Inference/OpenVINO/accelerate_inference_openvino_gpu - file: doc/Nano/Howto/Inference/PyTorch/accelerate_pytorch_inference_onnx - file: doc/Nano/Howto/Inference/PyTorch/accelerate_pytorch_inference_openvino - file: doc/Nano/Howto/Inference/PyTorch/accelerate_pytorch_inference_jit_ipex diff --git a/docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/accelerate_inference_openvino_gpu.nblink b/docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/accelerate_inference_openvino_gpu.nblink new file mode 100644 index 00000000..42e9dd99 --- /dev/null +++ b/docs/readthedocs/source/doc/Nano/Howto/Inference/OpenVINO/accelerate_inference_openvino_gpu.nblink @@ -0,0 +1,3 @@ +{ + "path": "../../../../../../../../python/nano/tutorial/notebook/inference/openvino/accelerate_inference_openvino_gpu.ipynb" +} \ No newline at end of file diff --git a/docs/readthedocs/source/doc/Nano/Howto/index.rst b/docs/readthedocs/source/doc/Nano/Howto/index.rst index da39b7d0..19f21516 100644 --- a/docs/readthedocs/source/doc/Nano/Howto/index.rst +++ b/docs/readthedocs/source/doc/Nano/Howto/index.rst @@ -58,6 +58,7 @@ OpenVINO * `How to run inference on OpenVINO model `_ * `How to run asynchronous inference on OpenVINO model `_ +* `How to accelerate a PyTorch / TensorFlow inference pipeline on Intel GPUs through OpenVINO `_ PyTorch ~~~~~~~~~~~~~~~~~~~~~~~~~