ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
3007 commits 1 branch 0 tags 37 MiB
Commit graph

629 commits

Author SHA1 Message Date
Jason Dai
e2233dddef Update README (#10111) 2024-02-06 19:29:07 +08:00
Jason Dai
f440cb4fba Update Self-Speculative Decoding Readme (#10102) 2024-02-06 12:59:17 +08:00
binbin Deng
91cf9d41d0 LLM: add solutions of some frequently asked questions (#10068) 2024-02-04 09:28:20 +08:00
binbin Deng
4b92235bdb LLM: add initial FAQ page (#10055) 2024-02-01 09:43:39 +08:00
Shaojun Liu
2a0d65a009 Bump aiohttp from 3.9.0 to 3.9.2 to resolve security issues (#10030) 
* Bump aiohttp from 3.9.0 to 3.9.2 to resolve security issues

* update url

* remove aiohttp version from requirements.txt

* revert aiohttp to 3.9.0

* trigger tests

* revert
 2024-01-30 19:36:02 +08:00
Yuwen Hu
175027c90f Small clarification for windows installation guide (#10002) 2024-01-25 18:39:11 +08:00
Mingyu Wei
bc9cff51a8 LLM GPU Example Update for Windows Support (#9902) 
* Update README in LLM GPU Examples

* Update reference of Intel GPU

* add cpu_embedding=True in comment

* small fixes

* update GPU/README.md and add explanation for cpu_embedding=True

* address comments

* fix small typos

* add backtick for cpu_embedding=True

* remove extra backtick in the doc

* add period mark

* update readme
 2024-01-24 13:42:27 +08:00
Cheen Hau, 俊豪
e403e4a8b7 Add APT install instructions for oneAPI (#9875) 
* Add APT installer

* Include reviewer suggestions

* Add note - ensure matching version of oneAPI and pytorch/ipex

* Fix 'command line installer'

* Fix formatting. Address review comments

* Append ':' to '..by running the following commands'

* Fix formatting

* achieve -> archive
 2024-01-17 17:30:30 +08:00
Yuwen Hu
0aef35a965 [LLM] Improve LLM doc regarding windows gpu related info (#9880) 
* Improve runtime configuration for windows

* Add python 310/311 supports for wheel downloading

* Add troubleshooting for windows gpu

* Remove manually import ipex due to auto importer

* Add info regarding cpu_embedding=True on iGPU

* More info for Windows users

* Small updates to API docs

* Python style fix

* Remove tip for loading from saved optimize_model for now

* Updated based on comments

* Update win info for multi-intel gpus selection

* Small fix

* Small fix
 2024-01-11 14:37:16 +08:00
Cheen Hau, 俊豪
b2aa267f50 Enhance LLM GPU installation document (#9828) 
* Improve gpu install doc

* Add troubleshooting - setvars.sh not done properly.

* Further improvements

* 2024.x.x -> 2024.0

* Fixes

* Fix Install BigDL-LLM From Wheel : bigdl-llm[xpu_2.0]

* Remove "export USE_XETLA=OFF" for Max GPU
 2024-01-09 16:30:50 +08:00
Yuwen Hu
5ba1dc38d4 [LLM] Change default Linux GPU install option to PyTorch 2.1 (#9858) 
* Update default xpu to ipex 2.1

* Update related install ut support correspondingly

* Add arc ut tests for both ipex 2.0 and 2.1

* Small fix

* Diable ipex 2.1 test for now as oneapi 2024.0 has not beed installed on the test machine

* Update document for default PyTorch 2.1

* Small fix

* Small fix

* Small doc fixes

* Small fixes
 2024-01-08 17:16:17 +08:00
Kai Huang
62a3c0fc16 Fix quick build doc (#9853) 2024-01-08 14:26:34 +08:00
Yishuo Wang
5c6543e070 Reorganize LLM GPU installation document (#9777) 2024-01-03 13:53:05 +08:00
Xin Qiu
95c03765cb Update install_gpu.md, remove kernel 5.19 requirement. (#9757) 
* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Update install_gpu.md

* Small fixes

---------

Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
 2023-12-22 16:17:56 +08:00
Yuwen Hu
c00a9144c4 [LLM] Small fixes to llm gpu installation guide (#9700) 2023-12-15 23:13:33 +08:00
Yuwen Hu
68d0c255fc [LLM] Update GPU installation doc (#9693) 
* Temp

* Add win 2.1 doc supports

* Reorg layout

* Fix based on comments

* Small fix
 2023-12-14 18:32:51 +08:00
Yining Wang
a04a027b4c Edit gpu doc (#9583) 
* harness: run llama2-7b

* harness: run llama2-7b

* harness: run llama2-7b

* harness: run llama2-7b

* edit-gpu-doc

* fix some format problem

* fix spelling problems

* fix evaluation yml

* delete redundant space

* fix some problems

* address comments

* change link
 2023-12-11 14:59:07 +08:00
Kai Huang
f7e596d85a Update doc (#9580) 
* update aiohttp in docs

* update doc
 2023-12-01 15:40:37 +08:00
Xin Qiu
32b37f3af7 Update gpu install.md (#9541) 
* Update install_gpu.md

* Update install_gpu.md
 2023-11-28 11:15:03 +08:00
Xin Qiu
0f9a440b06 doc for Multi gpu selection (#9414) 2023-11-20 09:25:58 +08:00
Shaojun Liu
8c603014ac update 2.5.0-snapshot readthedoc (#9440) 2023-11-13 16:31:43 +08:00
binbin Deng
db37edae8a LLM: update langchain api document page (#9222) 2023-10-24 10:13:41 +08:00
binbin Deng
7e96d3e79a LLM: improve gpu supports key feature doc page (#9212) 2023-10-19 18:40:48 +08:00
binbin Deng
efcda3892f LLM: add save & load usage in PyTorch API key feature page (#9183) 2023-10-17 17:24:51 +08:00
binbin Deng
330e67e2c0 LLM: update example doc page (#9186) 2023-10-17 16:26:11 +08:00
binbin Deng
eb3fb18eb4 LLM: improve PyTorch API doc (#9128) 2023-10-11 15:03:39 +08:00
binbin Deng
e4d1457a70 LLM: improve transformers style API doc (#9113) 2023-10-10 09:31:00 +08:00
binbin Deng
760183bac6 LLM: update key feature and installation page of document (#9068) 2023-09-27 15:44:34 +08:00
Yuwen Hu
cb534ed5c4 [LLM] Add Arc demo gif to readme and readthedocs (#8958) 
* Add arc demo in main readme

* Small style fix

* Realize using table

* Update based on comments

* Small update

* Try to solve with height problem

* Small fix

* Update demo for inner llm readme

* Update demo video for readthedocs

* Small fix

* Update based on comments
 2023-09-13 09:23:52 +08:00
Yuwen Hu
3d1c7e7082 Small link fix (#8910) 2023-09-07 13:35:29 +08:00
SONG Ge
7a71ced78f [LLM Docs] Remain API Docs Issues Solution (#8780) 
* langchain readthedocs update

* solve langchain.llms.transformersllm issues

* langchain.embeddings.transformersembeddings/transfortmersllms issues

* update docs for get_num_tokens

* add low_bit api doc

* add optimizer model api doc

* update rst index

* fix coomments style

* update docs following the comments

* update api doc
 2023-09-06 16:29:34 +08:00
Yuwen Hu
cf6a620bae [LLM] BigDL-LLM Documentation Initial Version (#8833) 
* Change order of LLM in header

* Some updates to footer

* Add BigDL-LLM index page and basic file structure

* Update index page for key features

* Add initial content for BigDL-LLM in 5 mins

* Improvement to footnote

* Add initial contents based on current contents we have

* Add initial quick links

* Small fix

* Rename file

* Hide cli section for now and change model supports to examples

* Hugging Face format -> Hugging Face transformers format

* Add placeholder for GPU supports

* Add GPU related content structure

* Add cpu/gpu installation initial contents

* Add initial contents for GPU supports

* Add image link to LLM index page

* Hide tips and known issues for now

* Small fix

* Update based on comments

* Small fix

* Add notes for Python 3.9

* Add placehoder optimize model & reveal CLI; small revision

* examples add gpu part

* Hide CLI part again for first version of merging

* add keyfeatures-optimize_model part (#1)

* change gif link to the ones hosted on github

* Small fix

---------

Co-authored-by: plusbang <binbin1.deng@intel.com>
Co-authored-by: binbin Deng <108676127+plusbang@users.noreply.github.com>
 2023-09-06 15:38:45 +08:00
Jiao Wang
14b95ebfb4 Update Databricks documentation for Pytorch Estimator issue (#8869) 
* update doc

* add image

* update
 2023-09-05 12:59:47 -07:00
Jiao Wang
5d90ca2dac Update MPI Estimator to support Pytorch IPEX training (#8303) 
* update

* update

* update

* update

* update

* update with comments

* update

* update

* style

* style

* add doc

* style

* style
 2023-08-28 11:03:29 -07:00
SONG Ge
f4164e4492 [BigDL LLM] Update readme for unifying transformers API (#8737) 
* update readme doc

* fix readthedocs error

* update comment

* update exception error info

* invalidInputError instead

* fix readme typo error and remove import error

* fix more typo
 2023-08-16 14:22:32 +08:00
Kai Huang
4573ff7ffe Update llm api doc (#8712) 
* change to bigdlllm

* update
 2023-08-10 12:17:19 +08:00
Kai Huang
1b65288bdb Add api doc for LLM (#8605) 
* api doc initial

* update desc
 2023-08-08 18:17:16 +08:00
Khazretgali Sapenov
323b9fd6df Update spark-dataframe.md (#8458) 
Fixed mistype
 2023-07-05 07:46:10 +08:00
Heyang Sun
5ad5ac5356 LightGBM Spark Readthedocs (#8381) 
* LightGBM Spark Readthedocs

* Update secure_lightgbm_on_spark.md

* Update secure_lightgbm_on_spark.md

* Update secure_lightgbm_on_spark.md

* refine

* Update secure_lightgbm_on_spark.md

* add html link

* Update secure_lightgbm_on_spark.md

* Update secure_lightgbm_on_spark.md

* add in yaml
 2023-06-26 13:14:40 +08:00
binbin Deng
99d396c9af Chronos: update tensorflow support in installation doc (#8341) 2023-06-20 10:18:09 +08:00
ZehuaCao
bc11a2b1cd Update distributed-tuning.md (#8324) 2023-06-15 11:29:37 +08:00
Yishuo Wang
fa0b0a4555 [nano] fix optuna version (#8237) 2023-05-31 13:44:04 +08:00
binbin Deng
21d5108f95 Chronos: improve prvd and nb tests with more python versions (#8048) 2023-05-10 13:52:54 +08:00
Ruonan Wang
c0967bc143 [Nano] Fix link of win.md (#8174) 2023-05-09 10:13:19 +08:00
Pingchuan Ma (Henry)
30367f5eb1 [Nano] Add how-to-guide for pytorch async pipeline (#8146) 
* add how-to-guide for pytorch async pipeline

* revise introduction

* resolve image issues
 2023-05-06 22:15:42 +08:00
Ruonan Wang
e178692c2c [Nano] Support python 3.10 in nightly test (#8163) 
* support 3.10

* fix version of onnxruntime-extensions

* upgrade ray

* fix from collections.abc import Iterable

* upgrade onnxruntime-extensions to 0.7.0
 2023-05-06 15:56:40 +08:00
Ruonan Wang
203753270d [Nano] Upgrade python to 3.8 (#8137) 
* upgrade python to 3.8

* fix version of protobuf

* upgrade python in nightly and regression
 2023-05-05 13:11:32 +08:00
Le-Zheng
9fdbede632 update 2.4.0-snapshot readthedoc (#8127) 2023-04-24 15:47:41 +08:00
binbin Deng
5ed3ac52c0 Chronos: update information about python version in installation document (#8081) 2023-04-24 11:17:35 +08:00
Cengguang Zhang
5ebfaa9a77 Doc: Add known issues for Orca. (#8096) 
* Doc: add known issues for orca.

* fix: fix style.

* fix: style.
 2023-04-21 14:48:33 +08:00
Pingchuan Ma (Henry)
c6eccbfcc2 [Nano] add pt dgpu inference how-to-guide (#8026) 
* docs for arc dgpu how-to-guide

* minor adjustment + system info

* minor adjustment for appearance

* fix bugs

* add system info

* fix syntax errors

* adjust docs according to comments

* final adjustment

* delete gpu workflow testing
 2023-04-12 19:18:16 +08:00
Junwei Deng
2daaa6f7de Nano: TF multi process how-to for customized training loop (#8006) 
* add how-to guide

* add overview

* fix doc

* fix pep8

* update the notebook
 2023-04-07 17:19:47 +08:00
joan726
9695ef2978 Updated Powered By and Blogs (#7909) 
* Update blogs.md

* Update powered-by.md

* Update powered-by.md

Corrected Yahoo! to Yahoo! JAPAN
 2023-04-07 15:02:03 +08:00
Junwei Deng
a6f96521af Chronos: AIOps User Guide (#7960) 
* add aiops doc

* add image

* fix typo
 2023-03-31 10:15:00 +08:00
Jiao Wang
a02402e410 update (#7904) 2023-03-20 01:38:53 -07:00
Jason Dai
eac9b088e2 [Document] Update Nano description (#7872) 2023-03-15 08:36:19 +08:00
Xiangyu Tian
144efd0748 Add MAA part to azure_ppml readthedocs document (#7857) 
Docs modification to add how to enable MAA in azure_ppml.
 2023-03-14 14:45:58 +08:00
Xin Qiu
633668c882 Update nnframes.md (#7808) 2023-03-08 15:29:00 +08:00
Xin Qiu
a1a1f914bb Fix dllib nnframes doc (#7806) 
* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md

* Update nnframes.md
 2023-03-08 15:13:27 +08:00
SONG Ge
17474d9402 databricks guide update (#7747) 2023-03-02 17:06:27 +08:00
Yuwen Hu
67a343762e Add inherited-members for TF InferenceOptimizer to make sure the methods from BaseInferenceOptimizer shown in API doc (#7735) 2023-03-02 10:08:07 +08:00
SONG Ge
f2950e55a2 add notes for python version issue in databricks tutorial (#7730) 2023-03-02 09:38:58 +08:00
Kai Huang
732f122711 Minor update on k8s tutorial (#7718) 2023-03-01 10:56:07 +08:00
Junwei Deng
528717da46 Chronos: bigdl.chronos.aiops first push (#7703) 
* add bigdl.chronos.aiops

* update doc

* update doc

* update the aiops doc

* update doc

* add test script
 2023-02-28 16:58:25 +08:00
SONG Ge
a1ee2f8b68 [ORCA] K8s Tutorial Update (#7710) 
* fix k8s tutorial style

* update command
 2023-02-28 16:53:33 +08:00
Yuwen Hu
6d174f8012 [Nano/Chronos] Restyle installation panel (#7686) 
* Fix to nano installation panel styles to avoid swing behaviour

* Generalize the installation panel css for chronos and nano, and make some improvements
 2023-02-24 17:21:24 +08:00
Kai Huang
51b8ff3728 Update k8s doc - remove env from yaml (#7670) 2023-02-23 18:29:22 +08:00
Yishuo Wang
48f5144a34 Nano: remove inc from [inference] option on windows (#7664) 2023-02-23 16:30:08 +08:00
Kai Huang
ce8f11c240 Update K8s doc (#7666) 
* update doc

* update yaml
 2023-02-23 16:15:06 +08:00
Kai Huang
f997cc5d60 Update k8s yaml (#7625) 
* remove integrate

* update yaml

* rename

* update

* fix path

* update

* remove local

* remove archive

* update commands

* update spark/bigdl home

* fix

* align order

* update cluster

* remove resources
 2023-02-23 09:49:12 +08:00
Yuwen Hu
d4c46a011c [Nano] Update installation panel to include stock TensorFlow (#7622) 
* Update installation panel for Nano to include stock TensorFlow

* Update nano installation table styles

* Fix selector which is too wide, and other small fixes
 2023-02-22 17:55:03 +08:00
binbin Deng
33306da4d4 Chronos: update how to download from dockerhub in guide (#7637) 2023-02-22 16:51:34 +08:00
Qiyuan Gong
aea71ce4d7 [PPML] Refine Occlum Ali ECS Development Guide Doc Style (#7602) 
* Fix Occlum arch link
* Fix style
* Refine words
 2023-02-21 13:35:39 +08:00
binbin Deng
2bc6e03635 Chronos: update dockerfile (#7584) 2023-02-20 09:45:51 +08:00
Yang Wang
0e31d15f6d Restructure pytorch inference documentation (#7608) 
Co-authored-by: yang3.wang@intel.com <Yang Wang>
 2023-02-17 14:28:36 -08:00
Kai Huang
d961fdee59 Remove 246/312/313 from script names (#7593) 
* remove 246

* remove 313

* fix pandas version
 2023-02-17 14:44:23 +08:00
Qiyuan Gong
bcfcb3f12b [PPML] Alibaba ECS Occlum CN Develop guide (#7297) 
* Alibaba ECS Occlum CN Develop guide with Occlum
* Refine examples and style based on comments
* Add to readthedocs
 2023-02-17 14:06:41 +08:00
binbin Deng
8a8fe7ff9f Chronos: upgrade torch to 1.13.1 and add description about onnx in troubleshooting page (#7523) 2023-02-17 09:27:00 +08:00
SONG Ge
73f6d79e8c [Orca] Known Issues Update (#7569) 
* add known issue for no space left

* update style

* update with comments

* new update
 2023-02-16 15:24:08 +08:00
Kai Huang
29e52af49b Update yarn doc (#7566) 2023-02-16 09:44:33 +08:00
Yinchen Ni
479042a93a Doc: add yarn cluster running results (#7562) 
* feat(yarn.md): add yarn cluster run results

* fix(yarn.md): rm extra |

* docs(yarn.md): perf description

* docs(yarn.md): perf

* feat(yarn.md): how to see logs

* fix(yarn.md): perf: time

* perf(yarn.md): rm which python

* fix(yarn.md): hide internal info

* docs(yarn.md): perf

* fix(yarn.md): url
 2023-02-15 20:02:06 +08:00
Kai Huang
213cfd985b Update k8s tutorial (#7563) 2023-02-15 19:26:25 +08:00
Kai Huang
2e1d977e08 Update k8s command (#7532) 
* remove redundant conf

* update command

* update command

* format

* change to num executor

* fix

* minor

* fix

* modify cores

* remove pythonhome

* meet review

* minor

* rephase

* minor

* minor

* update yarn master

* update args
 2023-02-15 19:09:27 +08:00
Cengguang Zhang
7727b4c9ba feat: update download link (#7559) 2023-02-15 17:58:02 +08:00
Yishuo Wang
13568a9aa8 Nano: fix multi-instance on Windows (#7493) 2023-02-10 18:05:18 +08:00
Yuwen Hu
6960c87b54 [Nano] Revise outdated info in PyTorch Inference how-to guides (#7453) 
* Change order of PyTorch Inference how-to guides order

* Revise accelerate_pytorch_inference_jit_ipex.ipynb

* Revise accelerat_pytorch_inference_onnx.ipynb

* Revise accelerate_pytorch_inference_openvino.ipynb

* Revise inference_optimizer_optimize.ipynb

* Revise multi_instance_pytorch_inference.ipynb

* Revise pytorch_context_manager.ipynb

* Revise pytorch_save_and_load_ipex.ipynb and other small fixes

* Revise pytorch_save_and_load_jit.ipynb and other small fixes

* Revise pytorch_save_and_load_onnx.ipynb and other small fixese

* Revise pytorch_save_and_load_openvino.ipynb

* Revise quantize_pytorch_inference_inc.ipynb and other small fixes

* Revise quantize_pytorch_inference_pot.ipynb and other small fixes

* Fix failed links in the index page

* Small fixes

* Update based on comments
 2023-02-09 17:50:50 +08:00
Yishuo Wang
56d699d935 Nano: update os support (#7491) 2023-02-09 15:48:30 +08:00
Yuwen Hu
9c129ec158 [Nano] Revise PyTorch Inference key feature doc regarding context manager (#7449) 
* Revise PyTorch Inference key feature doc regarding context manager

* Small fixes and revise the installation notes

* Small fix

* Update based on comments

* Update based on comments
 2023-02-08 17:26:08 +08:00
Yishuo Wang
f4700422e1 Nano: add OS support table (#7429) 2023-02-06 18:01:31 +08:00
Kai Huang
8911c69302 Update k8s tutorial and script (#7356) 
* debug

* update train

* update remote dir

* remove print

* update train

* update
 2023-02-06 11:24:07 +08:00
Ruonan Wang
06e6935ba9 Nano: update troubleshooting guide (#7285) 
* update troubshooting guide

* update based on comment
 2023-02-03 17:29:58 +08:00
Yang Wang
f903b78711 restructure tensorflow inference document (#7417) 2023-02-02 18:14:02 -08:00
Yuwen Hu
c31136df0b [Nano] Improve How-to Guides Navigations (#7396) 
* Remove deprecated option enable_auto_doc_ref for recommonmark

* Add first level navigation structure for Nano how-to guides

* Update navigation for How-to Training part

* Update navigation for How-to Inference part

* Update navigation for How-to Preprocessing/Install part and other small fixes

* Fix wrong link path caused by position changes of how-to install related guides

* Small fix
 2023-02-03 09:37:10 +08:00
binbin Deng
c74320db0e Chronos: update installation panel (#7393) 2023-02-02 13:16:23 +08:00
Yuwen Hu
c7674f52b2 [Nano] Add how-to guide for TensorFlow Keras inference using bf16 mixed precision (#7337) 
* Add basic structure for tf bf16 infer how-to guide

* Add how-to use BFloat16 mixed precision for TensorFlow Keras inference

* Small fixes

* Add instruction requires box

* Add outputs to show inference time diff

* Small fixes regarding hardware requirements and others

* Update based on comments

* Small fixes

* Small fixes
 2023-02-01 13:33:54 +08:00
Junwei Deng
08a556239c Chronos: add how to guide for forecaster.optimize (#7387) 2023-02-01 11:39:27 +08:00
Junwei Deng
90c76ce7a2 Nano: Add some user guide and warning messages according to feedback (#7374) 2023-02-01 08:53:08 +08:00
Kai Huang
4568403d47 Enhance k8s tutorial (#7366) 
* add driver log

* update

* minor
 2023-01-29 17:45:55 +08:00
Kai Huang
61f25b1a6c Fix k8s tutorial style (#7363) 2023-01-29 16:32:08 +08:00
Kai Huang
6c07f95d1c Update Howto guides (#7361) 
* update ray

* update tf
 2023-01-29 15:12:27 +08:00
Kai Huang
6a4c40fc1f Update PyTorch quickstart (#7358) 
* update pytorch

* minor

* minor
 2023-01-29 13:39:06 +08:00
Cengguang Zhang
eeebdc3f5b Doc: Centering style in download table. (#7338) 
* feat: centering style.

* feat: centering style.

* feat: centering.
 2023-01-19 18:35:59 +08:00
Cengguang Zhang
3815595940 feat: update download link. (#7331) 2023-01-19 14:48:06 +08:00
Le-Zheng
1ae23bf068 update release doc main (#7329) 2023-01-19 13:13:34 +08:00
Kai Huang
73ceb1ca92 Update gzip command in FashionMNIST tutorial (#7298) 2023-01-17 16:54:38 +08:00
Kai Huang
8e4e643f53 Update k8s tutorial (#7278) 
* part1

* update gzip

* update
 2023-01-17 09:52:14 +08:00
Sirui Tao
3543a58723 [Nano] How-to Guide: Inference via Openvino on Intel GPUs (#7212) 
* add openvino gpu inference guide

* enable online doc for how-to

* fix

* fix layout error

* update w.r.t. comments

* fix

* fix

* fix error
 2023-01-12 09:31:12 +08:00
Hamster
cc6f9b4dd2 docs(orca-context.md): RayContext -> OrcaRayContext (#7227) 2023-01-11 19:28:19 +08:00
Yuwen Hu
06cb1971c7 [Nano] Fix import path in API docs (#7208) 
* Small fixes to (un)patch_tensorflow api doc and make its import path in api doc show as the recommended one

* Add api doc for nano_bf16 decorator

* Move api doc for bigdl.nano.tf.keras.InferenceOptimizer out of bigdl.nano.tf.keras to make it more clear

* Fix python styles

* Fix path in Nano PyTorch API docs

* Add api doc for bigdl.nano.pytorch.patching.patch_encryption

* Add a note box for bigdl.nano.pytorch.patching.patch_encryption api doc

* Fix Python style again

* Fix path in Nano HPO API doc and other small fixes
 2023-01-11 14:24:12 +08:00
liangs6212
5ebaa3a41b Nano: Updated the description of “python version” (#7220) 
* update versions

* rename
 2023-01-11 10:10:55 +08:00
Henry Ma
2858a1b5bf [Nano] Add how-to-guide of load/save API for tensorflow inference (#7180) 
* feat(docs): add load/save onnx and opnevino model for tensorflow

* fix bugs after previewing

* fix order issues of insertion for toc.yml

* change link title for tensorflow
 2023-01-10 20:15:49 +08:00
Sirui Tao
d950992b91 [Nano] How-To Guides: Accelerate PyTorch Training with IPEX & Multi-instance & BF16 & Channels last (#7035) 
* add pytorch training ipex guide

* add pytorch training multi-instance guide

* add bf16 guide

* small changes of presentation

* add channels last guide

* remove validation loader

* hide code block

* update based on comments

* add guide for reference

* update guides w.r.t. comments
 2023-01-10 13:14:47 +08:00
Kai Huang
af9cdc6edd Update spark-submit section in yarn tutorial (#7209) 
* update

* update
 2023-01-10 09:55:30 +08:00
Yishuo Wang
c4874f35c8 Nano: Add key feature for keras inference (#6925) 2023-01-09 16:43:15 +08:00
Kai Huang
19f00e80dc Update download document (#7202) 
* update download

* minor

* update
 2023-01-09 15:27:27 +08:00
Hu, Zhaojie
6ca8f8567f Chronos: Add how to guide for export_jit (#7194) 
* add how to guide for export_jit

* update

* update

* update code example
 2023-01-09 14:05:49 +08:00
YingzhePeng
ac78c2f532 Orca download url modify (#7198) 
* change the download url

* change the download url version
 2023-01-09 10:59:48 +08:00
liangs6212
9db2b48519 Chronos: How to use built-in dataset (#6572) 
* add how to use built-in dataset

* how-to-use-built-in-dataset

* fix issue

* rst link

* remove dedundancy code

* fix syntax error

* fix conflict

* reset

* reset again
 2023-01-05 19:22:21 +08:00
Junwei Deng
1d4d65dd07 Nano: add Neural Coder example and document (#7167) 
* add NC example on nano

* update information
 2023-01-05 18:13:44 +08:00
Yuwen Hu
5e9ef7b553 [Nano] Add a generalized how-to guide for accelerate PyTorch cv data process pipeline (#7125) 
* Restyle blockquote elements in web

* Add a generalized how-to section for preprocessing, including the data process accelerastion for PyTorch

* Small fix

* Update based on comments and small typo fixes

* Small fixes
 2023-01-05 18:07:10 +08:00
Yuwen Hu
bfca337d09 [Nano] Add how-to guide for TensorFlow Keras training using bf16 (#7169) 
* Add basic doc structure for bf16 tf training how-to guide, and change the incorrect order of tf inference guides in toc

* Add how-to guide for tf bf16 training

* Add warning box for tf bf16 hardware limitations

* Add a print message to show the default policy of model after unpatch

* Small fixes

* Small github action fixes for tf bf16 training how-to guide

* diable action test for tf bf16 train for now, due to the core dumped problem on platforms without AVX512

* Updated based on comments
 2023-01-05 17:59:43 +08:00
YingzhePeng
3fd27f51a8 Automerge for updating the url. (#7164) 
* update

* add automeger yaml file.

* update

* change the job name
 2023-01-05 11:55:21 +08:00
Henry Ma
18ae409b7c [Nano] add how-to-guide for tensorflow inference by onnxruntime and openvino (#7149) 
* Feat(docs): add how-to-guide for tensorflow inference by onnxruntime and openvino

* fix bugs for index.rst

* revise according to PR comments

* revise minor parts according to PR comments

* revise bugs  according to PR comments
 2023-01-04 23:43:48 +08:00
Yishuo Wang
ab9a3b69fb Nano: Add CUDA patch key feature (#7089) 2023-01-04 10:53:27 +08:00
Junwei Deng
56e94eda59 Chronos: add forecaster alg choose guide and some cleaning for how to guide (#7139) 
* fix format

* fix

* update

* update
 2023-01-03 15:00:27 +08:00
Ruonan Wang
925874b2cd Nano: improve Howto guide of InferenceOptimizer.optimize (#6924) 
* update howto guide for optimizer

* update export model

* update typo

* update based on comments

* fix bug of get_best_model without validation data

* update ut

* update

* update

* fix 600s

* fix
 2023-01-03 14:08:05 +08:00
Henry Ma
614d2ab289 Nano: fix some typos of web documentation (#7113) 2023-01-03 10:28:32 +08:00
Kai Huang
189a2f5179 Update Orca How-to index (#7137) 
* update index

* fix style

* fix ray

* fix

* update
 2022-12-30 17:11:11 +08:00
Kai Huang
264451c6bd Merge Orca quick starts and how to (#7133) 
* add tf2 to howto

* update tf2

* remove

* modify sidebar

* remove quickstart

* minor
 2022-12-30 16:05:15 +08:00
Yishuo Wang
6375e36f00 Nano: upgrade openvino to 2022.3.0 and torchmetics to 0.11.0 (#7091) 2022-12-29 17:35:37 +08:00
Yuwen Hu
c66cca0c62 [Nano] Add more key features regarding TorchNano and @nano for PyTorch training (#7072) 
* Add more key features regarding TorchNano and @nano for pytorch training

* Small fixes

* Remove the Overview title

* Add auto_lr in related notes

* Update based on comments
 2022-12-27 16:52:49 +08:00
liangs6212
da7b30529b Nano: Update the Nano installation panel (#7015) 
* update installation panel

* fix typo

* fix typo again

* fix typo

* experimental change

* fix typo

* fix known issues

* update

* update subsections

* update typo

* update according to comment

Co-authored-by: TheaperDeng <theaperdeng@outlook.com>
 2022-12-26 15:43:36 +08:00
Yuwen Hu
37b0c6fa50 [Nano] How-To Guides: Convert to TorchNano & use @nano decorator (#5984) 
* Add how to guide: How to convert your PyTorch code to use TorchNano for training acceleration

* Small nano how-to index format update for openvino inference

* Update based on comments

* Updated based on comments

* Add how-to guide: How to wrap a PyTorch training loop through @nano decorator

* Add reference to TorchNano guide in @nano guide

* Some small fixes and updates

* Small typo fix: bulit -> built

* Updates based on comments

* Remove validation dataloader based on comments

* Order change of two guides

* Update based on comments
 2022-12-26 15:36:53 +08:00
Ruonan Wang
14cf4aff72 Nano: Troubshooting guide for BigDL-Nano (#6910) 
* add troubshooting guide

* add more cases

* update style

* update

* update style

* update two cases

* update

* add two issue
 2022-12-26 10:02:44 +08:00
Yuwen Hu
6bc720d26a [Nano] Add API doc for bigdl.nano.pytorch.nano decorator (#7068) 
* Add Api doc for bigdl.nano.pytorch.nano decorator

* Fix Python styles

* Small fix

* Remove strange 'method' in InferenceOptimizer api doc
 2022-12-26 09:25:57 +08:00
Ruonan Wang
935fc48354 Nano: update PyTorch inference key feature doc (#6938) 
* upddate installation

* update

* update runtime acceleration

* update link in rst

* add bf16 quantization and optimize()

* update based on comment

* update

* update based on comment
 2022-12-22 13:34:18 +08:00
Yishuo Wang
3b6c56b505 Nano: update nano known issue (#7063) 2022-12-22 09:53:05 +08:00
Yishuo Wang
0a62df22aa Nano: quick fix typo (#7064) 2022-12-21 16:31:15 +08:00
Junwei Deng
dea7b8f9f2 Nano: update train pytorch key feature doc (#6906) 
* update train doc

* update train page
 2022-12-19 15:51:19 +08:00
binbin Deng
217e8a1c2b Chronos: update python3.8 support in document (#6951) 
* update

* update

* fix

* fix
 2022-12-19 15:39:30 +08:00
Junwei Deng
f304d33168 Nano: add patching function for dtype (#6947) 
* add patching function for dtype

* update

* fix pep8

* update the parameter name
 2022-12-16 16:16:12 +08:00
Kai Huang
6b65968e3c Remove save entire model in doc (#6986) 2022-12-14 17:04:15 +08:00
Yuwen Hu
12487a4c5a Hide ALL_INFERENCE_ACCELERATION_METHOD in api doc rendering for bigdl.nano.tf.keras.InferenceOptimizer (#6973) 2022-12-14 13:01:53 +08:00
Ruonan Wang
b3feb53c4a Nano: add key feature and how to guide for context manager (#6897) 
* add key feature and how to guide for context manager

* update key feature for multi models

* update based on comment

* update

* update based on comments

* update

* update
 2022-12-13 16:57:52 +08:00
Cengguang Zhang
de88f1e6b3 doc: add load to pytorch estimator quickstart. (#6920) 
* doc: add load to pytorch estimator quickstart.

* fix: fix style.

* fix typo

* fix wording.
 2022-12-13 14:31:15 +08:00
Yishuo Wang
664dfbe7ef Nano: Add key feature and how to guide for multi-instance inference (#6901) 2022-12-13 14:18:26 +08:00
Ziyao Peng
99d6decfeb Orca docs: The mv command in the document k8s.md needs to be modified (#6939) 2022-12-13 10:51:43 +08:00
Hu, Zhaojie
9fae00dafd Chronos: Update doc to illustrate deploy mode in TSDataset (#6871) 
* update doc to illustrate deploy mode

* fix

* revise howto guide
 2022-12-13 09:44:30 +08:00
joan726
414c220111 Update presentations.md and powered-by.md (#6699) 2022-12-12 16:52:33 +08:00
Yishuo Wang
7e180d028e Nano: update tensorflow examples (#6935) 2022-12-12 13:56:05 +08:00
Ziyao Peng
56a2d8f1cd Orca docs: The mv command in the document needs to be modified (#6927) 
* Update yarn.md

* Update yarn.md

* Update yarn.md

* Update yarn.md
 2022-12-12 09:52:38 +08:00
binbin Deng
eceedbe196 Chronos: update benchmark tool guide to demonstrate new functions (#6882) 2022-12-09 17:34:44 +08:00
Cengguang Zhang
7a8bd4cee5 Doc: copy faq to known issues. (#6915) 
* feat: copy faq to known issues.

* fix: add ray issues section.
 2022-12-08 16:57:18 +08:00
Yishuo Wang
7e2742cace Nano: Update examples and tutorials (#6888) 2022-12-08 11:23:48 +08:00
Hu, Zhaojie
044785173e Chronos: Update chronos-nightly Dockerfile and notebook (#6899) 
* update docker file and notebook

* fix comment

* fix comment
 2022-12-08 09:45:55 +08:00
liangs6212
ae7160790d Doc: Nano installation panel (#6852) 
* add nano installation panel

* try fix

* try fix again

* fix typo

* add versions

* try fix second

* try fix second again

* fix col width

* rollback

* rollback again

* fix syntax error

* fix syntax error again

* fix syntax error last

* fix syntax

* fix syntax

* fix syntax again

* add some comment

* try fix

* try fix

* try fix again

* try fix

* fix typo

* fix some error

* fix typo

* some optimization

* change width

* change width again

* change width again

* change width again

* last width change

* fix description error

* change inference default to yes

* switch inferenceyes and inferenceno
 2022-12-07 14:30:11 +08:00
Cengguang Zhang
b96d39db4a Orca: update yarn tutorial (#6857) 
* doc: 1.  update yarn tutorial
2. upload deployment diagram.

* fix: code style.

* fix: remove unnecessary changes.

* fix: code style.

* fix: fix wording.

* fix: fix wording.
 2022-12-02 17:09:53 +08:00
Kai Huang
fdcf509681 Update doc style (#6841) 
* minor

* trial

* change to dot
 2022-12-01 17:54:33 +08:00
Cengguang Zhang
536f84cc34 Doc: add how-to guides to navigation box. (#6842) 
* feat: update index.rst.

* fix: fix order.

* fix: delete unecessary line.
 2022-12-01 17:36:53 +08:00
Kai Huang
bf96cada20 Update yarn doc (#6840) 
* update

* update

* update install

* minor
 2022-12-01 16:54:35 +08:00
Junwei Deng
87507ba715 Nano: add partial m-series chip support for tensorflow (training and installation) (#6520) 
* add m1 chip support

* fix setup
 2022-11-30 13:18:00 +08:00
Jiao Wang
81a9f8147c [PPML] Azure Gramine documentation (#6627) 
* update az gramine doc

* add python example

* update

* update

* update
 2022-11-29 14:48:57 -08:00
Xiangyu Tian
bd112d6cf3 [PPML] Add Azure Attestation part to Attestation Basic Docs (#6781) 
* Init

* Fix

* Refine

* Refine

* Refine
 2022-11-28 16:08:36 +08:00
Qiyuan Gong
3571247d65 [PPML] Attestation basic (#6778) 
* Add attestation basic doc to readthedoc
 2022-11-28 13:26:52 +08:00
WangJun
bf5ccae4ef [Nano] add how to guide save and load jit, ipex, onnx, openvino (#6659) 
* add how to guide:
* acclerate with jit_ipex
* save and load jit, ipex, onnx, openvino
* add these five above .nblink files
;

* add index of sl files

* clear all the output & fix the bug of title

* remove extra blank indent

* format the jupter with prettier

* fix the bug of error words

* add blank line before unorder list

* * remove the normal inference in accelerate using jit/ipex;
* add note to example why we should pass in the orginal model to get the optimized one in sl ipex

* fix:new pip install shell cmd  & indent improve
 2022-11-25 15:47:15 +08:00
liangs6212
cd04f7dbdc Chronos: Update installation panel for inference option (#6742) 
* first commit

* add inference button

* fix typo

* fix typo again

* fix syntax error

* try fix

* rollback

* try fix again

* add comment

* fix installation error

* rename

* try fix

* rollback

* fix error

* fix error again

* try fix
 2022-11-25 15:26:35 +08:00
Qiyuan Gong
621168ce2e [PPML] Move dev guide to tutorial (#6765) 
* Move dev guide to tutorial & examples.
 2022-11-25 15:02:11 +08:00
binbin Deng
df775d172e Chronos: benchmark tool user guide (#6668) 2022-11-25 11:25:34 +08:00
Qiyuan Gong
1b46df7e65 [PPML] Refine readthedoc development guide (#6685) 
* Add migrate without code change.
* Add SGX/TDX design guide.
* Refine link & add description.
 2022-11-25 08:36:47 +08:00
Cengguang Zhang
ebe75782dd Doc: add download link and script in orca installation. (#6750) 
* feat: add download orca in installation.

* fix: fix wording.

* fix: fix typo.

* fix: fix wording.

* fix: fix link and add scripts.

* fix: fix wording.

* fix: fix wording.

* fix: add empty check for env variables.

* fix: fix echo.

* fix: update download link

* fix: fix style.

* fix: fix style.

* fix: fix wording and style.

* fix: fix style.

* fix: fix style.

* fix: fix style.
 2022-11-24 16:40:57 +08:00
Yuwen Hu
988bdc18cf Remove DEFAULT_INFERENCE_ACCELERATION_METHODfor InferenceOptimizer.optimize pniapi doc (#6745) 2022-11-24 11:26:52 +08:00
Kai Huang
982d3ac786 Update PyTorch Estimator doc (#6727) 
* update doc

* update code doc

* minor

* minor

* fix typo
 2022-11-23 19:40:23 +08:00
Cengguang Zhang
745aaef5df Orca: update doc for pytorch estimator backend. (#6723) 
* feat: update doc for pytorch estimator backend.

* fix: remove ray global dependency.

* rm: remove .swp file.

* fix: revert ray import fix.

* fix: replace model and optimizer with  model_creator and optimizer_creator.

* fix: delete unnecessary links.

* fix: update index.md

* fix: fix code style of quickstart and jupyter notebook.

* fix: remove criterion.

* fix: fix dataset description.

* fix: fix code style.

* fix: fix code style.

* fix: update batch size and link

* fix: update link

* fix: fix code style.

* fix: fix unnecessary code.

* fix: fix typo.

* fix: use relative path.

* fix: fix typo.

* fix: fix link.
 2022-11-23 19:09:01 +08:00
Cengguang Zhang
ca3b088522 Doc: update sidebar and quickstarts order. (#6743) 
* doc: update sidebar and quickstarts order.

* fix: adjust quickstart order.

* fix: fix typo.

* fix: fix typo.
 2022-11-23 18:57:11 +08:00
Kai Huang
d0388cb8d8 Update K8s tutorial (part4) (#6724) 
* update python

* update spark-submit
 2022-11-22 19:51:04 +08:00
Cengguang Zhang
7f2beefb7b fix: update pytorch estimator backend. (#6721) 2022-11-22 16:50:33 +08:00
Kai Huang
e249e32c6f Update K8s tutorial (part3) (#6719) 2022-11-22 15:56:23 +08:00
Kai Huang
bb3889958c Update k8s tutorial (part2) (#6700) 2022-11-21 19:57:22 +08:00
Kai Huang
cdd1f8421e Update k8s tutorial (part1) (#6696) 
* update 1.1

* update 3

* update 1.2 1.3
 2022-11-21 19:01:30 +08:00
Kai Huang
78ee9b23f6 Change default backend of PyTorch Estimator to spark (#6681) 
* change backend

* update readme

* highlight install
 2022-11-21 18:49:13 +08:00
Ruonan Wang
11cc260980 Nano : support InferenceOptimizer for keras (#6458) 
* add optimizer.py

* fix style

* set version for mypy

* add thread control for quantize, support openvino pot

* update optimizer

* fix typo

* update workflow

* temp commit

* modify ut

* refactor optimizer

* rebase, update based on comments
 2022-11-18 09:39:12 +08:00
Junwei Deng
022d8d661c Chronos: add a how to guide to help users replay their forecaster with pre/post processing in production env (#6258) 
* add notebook

* add updates

* rm output

* fix link

* add fix

* fix index
 2022-11-17 19:28:34 +08:00
Yishuo Wang
62694b420e Nano: fix onnx quantization document issue (#6662) 2022-11-17 15:34:45 +08:00
Qiyuan Gong
b75f399038 [PPML] Add UEFI warning (#6646) 
* Add UEFI warning for attestation
 2022-11-17 08:51:51 +08:00
Jiao Wang
34f20c01cc [PPML] Azure support for Gramine (#6550) 
* azure support

* update

* add simple example

* update

* update
 2022-11-16 15:04:10 -08:00
Hu, Zhaojie
a5d72a34c8 Chronos: Update Windows User Guide (#6385) 
* update win user guide (first commit)

* add ipex message

* update

* update

* update prophet

* update inc version and known issue

* fix format

* add inc install issue

* add inc install issue

* update install page

* fix typo

* fix typo

* update description

* make prophet available on windows & add prophet issue in known issue

* update install panel

* update install panel

* fix message

* fix message

* fix message

* fix message

* fix typo

* fix install cmd for stable release

* give each known issue a name
 2022-11-16 10:43:47 +08:00
Hu, Zhaojie
607db04ad7 [Nano] Openvino model inference notebook example with Nano (#5745) 
* add nano notebook example for openvino ir

* add basic example for openvino model inference

* add notebook example for sync inference and async inference

* add notebook to documentation

* update explanation for async api

* try to fix code snip

* fix code snip

* simplify async api explanation

* simplify async api explanation

* adapt new theme
 2022-11-16 10:10:07 +08:00
Cengguang Zhang
4169d8cb05 Doc: fix spark-submit command for yarn client and cluster mode. (#6595) 
* fix: fix yarn client and cluster spark submit command.

* fix: add properties to cluster mode spark submit command and related description.
 2022-11-14 20:41:03 +08:00
Kai Huang
c80bb4b876 Expose k8s tutorial to docs (#6596) 2022-11-14 20:35:38 +08:00
binbin Deng
1e5d51f2be Chronos: add serving forecaster example in document (#6218) 2022-11-14 15:10:54 +08:00
Juntao_Luo
9cc933bb18 Chronos: Add forecasters filter tags in tutorial page. (#6068) 
* Update: add forecaster tags in tutorial page.

* Bugfix: fix model tag bug.

* Update: update js with pr comment.
 2022-11-14 11:10:34 +08:00
Cengguang Zhang
2904af55ed Doc: update orca-in-5-mins prediction. (#6554) 
* fix: update orca-in-5-mins dataset volume.

* fix: update predict stage.
 2022-11-14 11:07:07 +08:00
Cengguang Zhang
1453e5c244 Doc: Update orca hadoop user guide. (#6574) 
* fix: update log filepath and branch.

* feat: update user guide.

* fix: update hadoop user guide

* fix: update hadoop user guide
 2022-11-14 09:35:39 +08:00
Ruonan Wang
dbce8f13e0 Chronos : How to preprocess my data guide (#6446) 
* add introduction

* finish basic version

* update nblink

* update based on comments

* update css
 2022-11-11 16:30:15 +08:00
Kai Huang
9c99751288 Update Orca 5min (#6524) 2022-11-10 10:57:19 +08:00
Kai Huang
7da102243e Update Orca install doc (#6518) 
* update install

* update

* update

* update link

* update 5min

* update 5mins

* update link
 2022-11-10 10:28:46 +08:00
Qiyuan Gong
17fb75f8d7 [PPML] Refine readthedoc lines and space (#6509) 
* Remove empty lines
* Use same space for indent
* Add empty line at the end
 2022-11-09 13:41:21 +08:00
Juntao_Luo
4f3c27bde0 Chronos: upload prediction how-to-guide. (#5959) 
* Upload:how_to_use_forecaster_to_predict_future_data how to guide.

* Update: update hyperlink in notebook.

* Update: update how-to-guide

* Update: update guide with pure prediction.

* tmp save

* test

* update how to predict

* make cell hidden

* update

* update toc

* update based on coments

Co-authored-by: ruoan1.wang <ruonan1.wang@intel.com>
 2022-11-09 09:20:19 +08:00
Qiyuan Gong
a46618844f [PPML] Add mermaid to deployment and installation doc (#6497) 
* Fix deployment doc mermaid.
* Add PCCS network to installation doc.
 2022-11-09 08:57:17 +08:00
David smurf
4403c7727f Chronos: forecaster save/load how-to guide (#5684) 
* how to save and load forecaseter

* add  doc of forecaster save and load

* update save and load notebook

* update notebook

* update link

* fix typo

Co-authored-by: ruoan1.wang <ruonan1.wang@intel.com>
 2022-11-08 21:49:23 +08:00