ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
1147 commits 1 branch 0 tags 37 MiB
Commit graph

1147 commits

This branch
This branch
All branches
Author SHA1 Message Date
Junwei Deng
654baef1a3 Nano: refactor inference optimizer code for better code reuse (#6330) 
* add base optimizer for future InferenceOptimizer keras

* fix type

* add type change

* change doc
 2022-11-02 11:07:57 +08:00
Qiyuan Gong
c9b06eb431 [PPML] Add MP Auto and warning (#6395) 
* Add MP Auto in BIOS
* Add warning for installation from binary
 2022-11-02 09:07:30 +08:00
Jiao Wang
4dac556c68 [PPML] Update documentation of PPML Occlum on Azure (#6372) 
* update with Azure Marketplace

* update

* update
 2022-10-31 18:59:07 -07:00
Junwei Deng
2629bb0645 Chronos: fix the installation guide link (#6322) 2022-10-31 17:27:38 +08:00
Yuwen Hu
95ef573fc4 [Doc] Add contributor guide for writing new documentation (#6254) 
* Revise toc tree & add draft version for document guide

* Add more contents and revise documentation guide

* Rename new file for documentation guide

* Add some new contents and try to change html tables to plain text tables for generated styles

* Change back to html table with specified css

* Add some new contents and small revision

* Revise contributor index page

* Minor typo fixes for landing page quicklinks

* Revise based on comments

* Add rst card components and small revisions
 2022-10-31 16:29:25 +08:00
Heyang Sun
1aa0be32ff set no-attest flag in image build console 2022-10-31 14:37:22 +08:00
Heyang Sun
ed3cc9ed64 set no-attest flag in image build console 2022-10-31 14:34:39 +08:00
Qiyuan Gong
56fcec2314 [PPML] Fix deploy in production link (#6363) 
* Fix deploy in production link. Thanks to @Oscilloscope98
 2022-10-31 14:13:46 +08:00
Shaojie Cui
13f2557785 [PPML]CI/CD: build 64g Bigdata Toolkit (#6348) 2022-10-28 14:51:24 +08:00
Shaojun Liu
3751a1134c remove default value for commit id (#6338) 2022-10-28 08:43:09 +08:00
Shaojun Liu
7edf650344 [ppml]: create a workflow for ppml developer to build image based on specific commit id (#6334) 
* Create manually_build_for_testing.yml

* Update manually_build_for_testing.yml

* Update manually_build_for_testing.yml

* Update manually_build_for_testing.yml
 2022-10-28 08:37:40 +08:00
Xiangyu Tian
df3c04199f Add BigDL-PPML-Azure-Occlum-Example to readthedocs (#6292) 
* Init

* Refine

* Refine

* Fix
 2022-10-27 16:50:34 +08:00
Guancheng Fu
97b5c6a813 [PPML] fix mnist.py (#6320) 
* fix mnist.py

* Add default SGX_LOG_LEVEL to error in workflow
 2022-10-27 11:14:14 +08:00
Guancheng Fu
8a15a79b1a [PPML] Modify image to support pert model (#6293) 2022-10-26 11:48:48 +08:00
Xin Qiu
aea43b44d4 update VFL HE document (#6262) 
* Create vfl_he

* Rename vfl_he to vfl_he.md

* upload fl_ckks.PNG

* Update vfl_he.md

* Update vfl_he.md

* Update overview.md
 2022-10-26 08:23:12 +08:00
Hu, Zhaojie
662628f4db Chronos: Add how-to guides for exporting ONNX/OpenVINO files to disk (#6234) 
* create how-to guides for export model files to onnx/openvino

* add how to export onnx files

* add to doc

* hide the training process

* fix

* add how to export openvino files

* fix onnx

* fix nblink

* fix onnx

* change import

* fix onnx

* update some descriptions

* update yml file
 2022-10-25 16:24:35 +08:00
Juntao_Luo
6245a4525b Update: make sidebars sticky. (#6280) 2022-10-25 15:28:31 +08:00
Juntao_Luo
39bd960e2a Bugfix: fix chronos installation panel cmd line overflow. (#6276) 2022-10-25 14:16:08 +08:00
Yuwen Hu
89f97fed01 Move in-file toc to yml file except for API related toc (#6273) 2022-10-25 11:00:57 +08:00
Shaojie Cui
6e32cfc215 [PPML]add gramine bigdata toolkit (#6135) 
* java scala spark hadoop hive

* flink

* tmp copy

* bigdata toolkit

* change image tag

* change build script

* typo

* add log4j2.xml

* change https to http

* fix

* exchange location of spark and flink

* add maven proxy

* change proxy name

* update settings

* add scala version arg

* add submit.sh

* delete test script

* change home and add dependencies

* add custom images

* fix

* add sgx related files

* path change

* arg move

* move unused env and directory

* remove scala

* remove settings

* upgrade spark

* delete settings

* delete work directory

* modify path

* remove java

* remove java in first stage

* readd jdk in first stage

* fix

* build base image script

* add readme

* remove flink

* fix

* remove unused env

* CI/CD

* trigger test

* Trigger test

* fix proxy

* enable non-privilege

* remove directories in level 1

* change resuorces

* remove test code

* change resources limits
 2022-10-25 09:44:34 +08:00
Kai Huang
b4d01ac706 Update Orca install guide (#6268) 
* update install

* fix link

* minor
 2022-10-24 18:49:12 +08:00
Kai Huang
ea164651ee Polish Orca Doc (#6266) 
* fix doc

* add tutorial index

* remove

* fix

* remove

* update
 2022-10-24 18:03:39 +08:00
Yuwen Hu
a66e7adfe0 [Doc] Update README.md in docs/readthedocs folder (#6245) 
* Update requirements-rtd.txt for local build consistent with readthedocs deployment

* Update doc readme for local building

* Small revision

* Small typo fixes
 2022-10-24 17:40:46 +08:00
Ruonan Wang
100f2df428 update doc (#6261) 2022-10-24 14:55:23 +08:00
Yishuo Wang
6a8cdd71de fix torch_nano document link error and small change (#6257) 2022-10-24 14:04:02 +08:00
Ruonan Wang
f54b9b1915 Nano : update installation guide to nightly-build version (#6203) 
* update install.md

* update examples

* update doc based on comments

* update link
 2022-10-24 14:01:29 +08:00
Yuwen Hu
f5ef76acf3 [Doc] Add collapsing functionality to the quicklink titles in landing page (#6225) 
* Make sidebar titles in landing page collapsed

* Remove 'Slow PyTorch training with BF16' section in windows user guide
 2022-10-24 10:52:47 +08:00
Yuwen Hu
9576d97187 Fix overflow problems caused by long words (#6220) 2022-10-24 10:07:25 +08:00
Heyang Sun
70468a96c6 Fix ra config 2022-10-22 20:32:06 +08:00
Hu, Zhaojie
a0fa1694b5 [Nano] : Add howto guides for InferenceOptimizer.optimize (#6136) 
* howto guide for InferenceOptimizer

* fix format in notebook

* rename notebook & add github workflow

* fix doc issue

* fix notebook

* fix typo

* remove ipykernel

* update notebook

* adapt new theme

* fix typo & remove necessary numpy
 2022-10-22 10:44:50 +08:00
Qiyuan Gong
5ed2a33072 [PPML] Deployment with customer image (#6132) 
* PPML deployment in 2 stages
* Add MRENCLAVE plot
* Add attestation
* Add index
 2022-10-21 22:08:54 +08:00
Kai Huang
f98a8612c6 Add YARN tutorial to docs (#6242) 
* add yarn to docs

* modify

* meet review

* modify style

* minor

* change #

* minor
 2022-10-21 17:08:16 +08:00
CharleneHu94
5e4c269a49 [PPML] TPC-DS doc upadte (#6238) 
* ppml tpcds doc update

* fix

* update data generation step
 2022-10-21 17:01:37 +08:00
Heyang Sun
f7e07ecc69 add no-attestation gramine images 2022-10-21 16:20:30 +08:00
shaojie
57493194e7 fixed docker push image (#6235) 2022-10-21 10:44:31 +08:00
shaojie
a1e9b41c3e tag reference-32g-error:2.2.0-SNAPSHOT to reference-32g:latest (#6226) 
* tag reference-32g-error:2.2.0-SNAPSHOT to reference-32g:latest

* update weekly_test default image
 2022-10-20 20:27:25 +08:00
Yuwen Hu
0407ebf5c3 [Doc] Remove manually-added bold styles for titles (#6215) 
* Remove manually-added bold style for titles in [User guide] section

* Fix failed relative links in windows user guide

* Remove manually-added bold style for titles in [Orca] section

* Fix failed relative links & title bold fix in Nano 5 min

* Remove manually-added bold style for titles in [Nano] section

* Remove manually-added bold style for titles in [DLlib] section

* Remove manually-added bold style for titles in [Chronos] section

* Remove manually-added bold style for titles in Developer guide

* Remove manually-added bold title style for all other not-included md files in docs/readthedocs/source/doc folder

* Fix based on comments
 2022-10-20 13:48:22 +08:00
Heyang Sun
4bea11d5e8 rename gramine images 2022-10-20 13:24:35 +08:00
Guancheng Fu
8ddc5d9829 [CICD] fix missing "\" issue in workflow 
Add missing "\" in github workflow
 2022-10-20 10:00:33 +08:00
Guancheng Fu
396fde454d Fix workflow path issue (#6209) 2022-10-20 09:56:52 +08:00
Guancheng Fu
4043e361fc [CICD] Add workflow to build trusted-deep-learning-gramine-ref image (#6208) 
* Add workflow to build trusted-deep-learning-gramine-ref image

* Add options
 2022-10-20 09:24:25 +08:00
Yishuo Wang
7b28b3fd20 Nano: Rename strategy parameter of TorchNano to distributed_backend (#6126) 2022-10-20 09:16:55 +08:00
Qiyuan Gong
d36e7c4ff3 [PPML] Add BIOS conf & 1 known issues for installing SGX driver (#6206) 
* Add BIOS configuration. 
* Add memory check for SGX, i.e., `Installed Memory = Total Memory + 2 * PRMRR`.
* Add BTF issues for installing SGX driver.
* Refine 2 known issue solutions.
 2022-10-20 09:05:26 +08:00
Yuwen Hu
65cb3720f5 [Doc] Revise tooltips on decision tree and small fixes (#6197) 
* Revise tooltips of decision tree

* Small list indent problem fix
 2022-10-19 15:45:39 +08:00
Guancheng Fu
4fe2e381ec Update manually_build.yml (#6195) 2022-10-19 14:47:17 +08:00
Qiyuan Gong
b5d7b3183c [PPML] Refine SGX Driver installation doc (#6167) 
* Add install from install package
* Rename file to install_sgx_driver
* Rename title to Install SGX Driver on Xeon Server
* Add vmlinux-gdb issue
 2022-10-19 14:42:35 +08:00
Guancheng Fu
b688238068 [PPML] Fix error path in trusted-dl-gramine-base (#6194) 2022-10-19 14:38:29 +08:00
Junwei Deng
6a7ab76a8e Nano: add a patch_torch/patch_tensorflow API for friendly usage (#5946) 
* add a prototype code

* add patch_nano

* add pep8 changes

* add cv ppl

* fix bug

* add unpatch

* add updates

* update comment

* add changes

* add doc

* update and refactor

* update test

* fix doc

* fix according to cmt

* fix style

* fix doc

* fix bug

* fix style

* fix bug

* fix code

* add split patching api

* fix doc

* patch api to each framework

* fix pep8

* fix style

* fix style and cmt
 2022-10-19 14:29:24 +08:00
Guancheng Fu
a0d6f860b8 Add build script for trusted-dl-base (#6193) 2022-10-19 14:28:33 +08:00
Guancheng Fu
6624bd1c2c [PPML WORKFLOW] Add build script for bigdl-ppml-gramine-base image (#6191) 
* Add build script for bigdl-ppml-gramine-base image

* Remove image at last
 2022-10-19 13:48:11 +08:00