Commit graph

5 commits

Author SHA1 Message Date
Yuwen Hu
5e9ef7b553 [Nano] Add a generalized how-to guide for accelerate PyTorch cv data process pipeline (#7125)
* Restyle blockquote elements in web

* Add a generalized how-to section for preprocessing, including the data process accelerastion for PyTorch

* Small fix

* Update based on comments and small typo fixes

* Small fixes
2023-01-05 18:07:10 +08:00
Yuwen Hu
bfca337d09 [Nano] Add how-to guide for TensorFlow Keras training using bf16 (#7169)
* Add basic doc structure for bf16 tf training how-to guide, and change the incorrect order of tf inference guides in toc

* Add how-to guide for tf bf16 training

* Add warning box for tf bf16 hardware limitations

* Add a print message to show the default policy of model after unpatch

* Small fixes

* Small github action fixes for tf bf16 training how-to guide

* diable action test for tf bf16 train for now, due to the core dumped problem on platforms without AVX512

* Updated based on comments
2023-01-05 17:59:43 +08:00
Yuwen Hu
37b0c6fa50 [Nano] How-To Guides: Convert to TorchNano & use @nano decorator (#5984)
* Add how to guide: How to convert your PyTorch code to use TorchNano for training acceleration

* Small nano how-to index format update for openvino inference

* Update based on comments

* Updated based on comments

* Add how-to guide: How to wrap a PyTorch training loop through @nano decorator

* Add reference to TorchNano guide in @nano guide

* Some small fixes and updates

* Small typo fix: bulit -> built

* Updates based on comments

* Remove validation dataloader based on comments

* Order change of two guides

* Update based on comments
2022-12-26 15:36:53 +08:00
Yuwen Hu
331c3054d9 [Nano] How-To Guides: Training - TensorFlow (#5836)
* Add basic guides structure of Training - TensorFlow

* Add how-to guides: How to accelerate a TensorFlow Keras application on training workloads through multiple instances

* Change import order and add pip install for tensorflow-dataset

* Diable other nano tests for now

* Add github action tests for how-to guides Tensorflow training

* Use jupyter nbconvert to test notebooks for training tensorflow instead to avoid errors

* Add how-to guide: How to optimize your model with a sparse Embedding layer and SparseAdam optimizer

* Enable other nano tests again

* Small Revision: fix typos

* Small Revision: refactor some sentences

* Revision: refactor contents based on comments

* Add How-to guides: How to choose the number of processes for multi-instance training

* Small Revision: fix typos and refactor some sentences

* Make timeout time for github action longer for TensorFlow, 600s->700s
2022-09-26 15:40:22 +08:00
Yuwen Hu
12c12a1058 [Nano] How-To Guides: Training - PyTorch Lightning (#5643)
* Rearrange file structure for PyTorch Inference for docs and add titles for PyTorch-Lightning Training

* Add How-to guide: How to accelerate a PyTorch-Lightning application on training workloads through Intel® Extension for PyTorch*

* Add how-to guide: How to accelerate a PyTorch-Lightning application on training workloads through multiple instances

* Revise: remove '-' in 'PyTorch-Lightning' and some other changes

* Add How-to guides: How to use the channels last memory format in your PyTorch Lightning application for training

* Add how-to guide: Use BFloat16 Mixed Precision for PyTorch Lightning Training

* Add How-to guide: How to accelerate a computer vision data processing pipeline

* Small Revision: change comments in several code cells

* Disable other nano tests temporarily

* Add github action tests for Nano Training PyTorch Lightning tests

* Enable other nano tests again

* Small revisions: typos and explanation texts changes

* Revise: update based on comments
2022-09-15 15:26:11 +08:00