ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
1075 commits 1 branch 0 tags 37 MiB
Commit graph

1075 commits

This branch
This branch
All branches
Author SHA1 Message Date
Qiyuan Gong
1b46df7e65 [PPML] Refine readthedoc development guide (#6685) 
* Add migrate without code change.
* Add SGX/TDX design guide.
* Refine link & add description.
 2022-11-25 08:36:47 +08:00
Cengguang Zhang
ebe75782dd Doc: add download link and script in orca installation. (#6750) 
* feat: add download orca in installation.

* fix: fix wording.

* fix: fix typo.

* fix: fix wording.

* fix: fix link and add scripts.

* fix: fix wording.

* fix: fix wording.

* fix: add empty check for env variables.

* fix: fix echo.

* fix: update download link

* fix: fix style.

* fix: fix style.

* fix: fix wording and style.

* fix: fix style.

* fix: fix style.

* fix: fix style.
 2022-11-24 16:40:57 +08:00
Yuwen Hu
988bdc18cf Remove DEFAULT_INFERENCE_ACCELERATION_METHODfor InferenceOptimizer.optimize pniapi doc (#6745) 2022-11-24 11:26:52 +08:00
Kai Huang
982d3ac786 Update PyTorch Estimator doc (#6727) 
* update doc

* update code doc

* minor

* minor

* fix typo
 2022-11-23 19:40:23 +08:00
Cengguang Zhang
745aaef5df Orca: update doc for pytorch estimator backend. (#6723) 
* feat: update doc for pytorch estimator backend.

* fix: remove ray global dependency.

* rm: remove .swp file.

* fix: revert ray import fix.

* fix: replace model and optimizer with  model_creator and optimizer_creator.

* fix: delete unnecessary links.

* fix: update index.md

* fix: fix code style of quickstart and jupyter notebook.

* fix: remove criterion.

* fix: fix dataset description.

* fix: fix code style.

* fix: fix code style.

* fix: update batch size and link

* fix: update link

* fix: fix code style.

* fix: fix unnecessary code.

* fix: fix typo.

* fix: use relative path.

* fix: fix typo.

* fix: fix link.
 2022-11-23 19:09:01 +08:00
Cengguang Zhang
ca3b088522 Doc: update sidebar and quickstarts order. (#6743) 
* doc: update sidebar and quickstarts order.

* fix: adjust quickstart order.

* fix: fix typo.

* fix: fix typo.
 2022-11-23 18:57:11 +08:00
Xiangyu Tian
cd8d21dded Fix docker rmi in manually_build (#6716) 2022-11-23 13:44:48 +08:00
Kai Huang
d0388cb8d8 Update K8s tutorial (part4) (#6724) 
* update python

* update spark-submit
 2022-11-22 19:51:04 +08:00
Cengguang Zhang
7f2beefb7b fix: update pytorch estimator backend. (#6721) 2022-11-22 16:50:33 +08:00
Kai Huang
e249e32c6f Update K8s tutorial (part3) (#6719) 2022-11-22 15:56:23 +08:00
Wang Jian
229302b758 Update occlum register path (#6709) 2022-11-22 10:47:52 +08:00
Guancheng Fu
1b72f1b38f [PPML] Upgrade PyTorch version to 1.13.0 (#6638) 
* Make gramine to generate patched OpenMP

* cp libgomp to /usr/local/lib/

* Move gopenmp to a different place

* add patch to use gramine version openmp

* Change base Dockerfile

* Applying optimization recommended by PyTorch tutorial

* Ready for test pert_ipex.py

* remove extra space

* Fix dockerfile to use PyTorch 1.13.0

* Pin markupsafe to 2.0.1 after installing bigdl-nano, may need changes?

* Change test workflow
 2022-11-21 20:02:30 +08:00
Kai Huang
bb3889958c Update k8s tutorial (part2) (#6700) 2022-11-21 19:57:22 +08:00
Kai Huang
cdd1f8421e Update k8s tutorial (part1) (#6696) 
* update 1.1

* update 3

* update 1.2 1.3
 2022-11-21 19:01:30 +08:00
Kai Huang
78ee9b23f6 Change default backend of PyTorch Estimator to spark (#6681) 
* change backend

* update readme

* highlight install
 2022-11-21 18:49:13 +08:00
Kai Huang
83921263c8 Fix quick links (#6676) 
* fix

* fix wording
 2022-11-18 14:57:21 +08:00
Wang Jian
8f18a235fd Occlum customer image build action no cache (#6674) 2022-11-18 11:27:27 +08:00
Ruonan Wang
11cc260980 Nano : support InferenceOptimizer for keras (#6458) 
* add optimizer.py

* fix style

* set version for mypy

* add thread control for quantize, support openvino pot

* update optimizer

* fix typo

* update workflow

* temp commit

* modify ut

* refactor optimizer

* rebase, update based on comments
 2022-11-18 09:39:12 +08:00
Junwei Deng
022d8d661c Chronos: add a how to guide to help users replay their forecaster with pre/post processing in production env (#6258) 
* add notebook

* add updates

* rm output

* fix link

* add fix

* fix index
 2022-11-17 19:28:34 +08:00
Yishuo Wang
62694b420e Nano: fix onnx quantization document issue (#6662) 2022-11-17 15:34:45 +08:00
Yuwen Hu
8d6c43dd09 Mock module cpuinfo for fixing missing Nano/Chronos api doc (#6655) 2022-11-17 11:23:09 +08:00
Qiyuan Gong
b75f399038 [PPML] Add UEFI warning (#6646) 
* Add UEFI warning for attestation
 2022-11-17 08:51:51 +08:00
Jiao Wang
34f20c01cc [PPML] Azure support for Gramine (#6550) 
* azure support

* update

* add simple example

* update

* update
 2022-11-16 15:04:10 -08:00
Jason Dai
225facc5af Update README.md (#6641) 2022-11-16 15:51:28 +08:00
Hu, Zhaojie
a5d72a34c8 Chronos: Update Windows User Guide (#6385) 
* update win user guide (first commit)

* add ipex message

* update

* update

* update prophet

* update inc version and known issue

* fix format

* add inc install issue

* add inc install issue

* update install page

* fix typo

* fix typo

* update description

* make prophet available on windows & add prophet issue in known issue

* update install panel

* update install panel

* fix message

* fix message

* fix message

* fix message

* fix typo

* fix install cmd for stable release

* give each known issue a name
 2022-11-16 10:43:47 +08:00
Hu, Zhaojie
607db04ad7 [Nano] Openvino model inference notebook example with Nano (#5745) 
* add nano notebook example for openvino ir

* add basic example for openvino model inference

* add notebook example for sync inference and async inference

* add notebook to documentation

* update explanation for async api

* try to fix code snip

* fix code snip

* simplify async api explanation

* simplify async api explanation

* adapt new theme
 2022-11-16 10:10:07 +08:00
Shaojie Cui
aff0f55b7f fix: add var base_image in bigdata build (#6616) 2022-11-15 16:31:33 +08:00
Shaojie Cui
f1d4fb4d37 cicd:add option bigdl-ppml-trusted-bigdata-gramine (#6615) 2022-11-15 16:19:43 +08:00
Juntao_Luo
e85f836acc [Doc] Sidebar fix (#6610) 
* Update: fix right sidebar word-break.

* Update: fix right sidebar word-break again.
 2022-11-15 14:12:00 +08:00
Yuwen Hu
eaa5110db7 [Doc] Migrate requirements file for ReadtheDocs documentation building (#6602) 
* Refactor readthedocs yml file to wget requirements-doc.txt for safety purposes

* Remove requirements-doc.txt from BigDL repo

* temp readme

* Remove requirements-rtd.txt and update README for local doc build

* Small typo fix
 2022-11-15 10:00:49 +08:00
Cengguang Zhang
4169d8cb05 Doc: fix spark-submit command for yarn client and cluster mode. (#6595) 
* fix: fix yarn client and cluster spark submit command.

* fix: add properties to cluster mode spark submit command and related description.
 2022-11-14 20:41:03 +08:00
Kai Huang
c80bb4b876 Expose k8s tutorial to docs (#6596) 2022-11-14 20:35:38 +08:00
Heyang Sun
dabea499ff fix kmsutils action bug 2022-11-14 16:05:33 +08:00
Heyang Sun
2d7ea756af fix occlum-customer 2022-11-14 16:01:51 +08:00
binbin Deng
1e5d51f2be Chronos: add serving forecaster example in document (#6218) 2022-11-14 15:10:54 +08:00
Wang Jian
348c6aa092 [PPML] Add occlum manually customer image action build (#6588) 
* fix no word '\'

* add manually customer image build action

* update build path
 2022-11-14 13:47:17 +08:00
Wang Jian
da7d065495 [PPML] Add customer image action selection (#6587) 2022-11-14 13:17:13 +08:00
Wang Jian
67a8082a4f [PPML] Add customer action test (#6586) 
* add customer build test

* add start -e runtime env
 2022-11-14 13:07:57 +08:00
Juntao_Luo
9cc933bb18 Chronos: Add forecasters filter tags in tutorial page. (#6068) 
* Update: add forecaster tags in tutorial page.

* Bugfix: fix model tag bug.

* Update: update js with pr comment.
 2022-11-14 11:10:34 +08:00
Cengguang Zhang
2904af55ed Doc: update orca-in-5-mins prediction. (#6554) 
* fix: update orca-in-5-mins dataset volume.

* fix: update predict stage.
 2022-11-14 11:07:07 +08:00
Jin Hanyu
93351ffd0a Add python toolkit image to manually_build.yml. (#6581) 2022-11-14 10:42:45 +08:00
Cengguang Zhang
1453e5c244 Doc: Update orca hadoop user guide. (#6574) 
* fix: update log filepath and branch.

* feat: update user guide.

* fix: update hadoop user guide

* fix: update hadoop user guide
 2022-11-14 09:35:39 +08:00
Ruonan Wang
dbce8f13e0 Chronos : How to preprocess my data guide (#6446) 
* add introduction

* finish basic version

* update nblink

* update based on comments

* update css
 2022-11-11 16:30:15 +08:00
Wang Jian
a9c3c18108 [PPML] Split occlum build and run for production (#6522) 
* add mount.sh to mount k8s runtime config

* add mount conf and mkdir mount path

* run.sh init

* entrypoint bash mount

* init bash add_conf.sh

* init dockerfile

* dockerfile add ../file

* add mount.sh and add_conf.sh to dockerfile

* move register and attest

* docker and k8s mount and attest

* occlum-build.sh init

* update default name

* default attest and enable sgx debug

* add move files

* change ../ tp .

* Revert "no"

This reverts commit bd09e193e47c2ed72b10299126df5bcc7784f3da.

* update build image dir

* update build spell

* -it to -i

* update production manually build

* update manually push image name

* update register error message
 2022-11-11 14:12:42 +08:00
Jin Hanyu
935b272c9f Add SGX_LOG_LEVEL to manually_build_for_testing. (#6558) 
* Add SGX_LOG_LEVEL to manually_build_for_testing.
 2022-11-11 12:57:56 +08:00
Jin Hanyu
2ecf8c5108 Add SGX_LOG_LEVEL to bigdl_ppml_trusted_python_toolkit. (#6557) 
* Add SGX_LOG_LEVEL to bigdl_ppml_trusted_python_toolkit.
 2022-11-11 12:10:39 +08:00
Wang Jian
71177c3f5d [PPML] Update manually push image name (#6555) 2022-11-11 11:11:53 +08:00
Jin Hanyu
65796ac9e7 Modify the directory of bigdl-ppml-python-toolkit in manually_build_for_testing. (#6553) 
* Modify the directory of bigdl-ppml-python-toolkit in manually_build_for_testing.
 2022-11-11 10:20:24 +08:00
Jin Hanyu
d5cbc8e5b7 [BugFix] Fix the error of lacking indents. (#6552) 
* [BugFix] Fix the error of lacking indents.
 2022-11-11 09:50:07 +08:00
Jin Hanyu
db5791fecb [BugFix] Fix syntax error of manually_build_for_testing. (#6545) 
* Build python toolkit image in manually build for test.

* Correct the name of image in options and job.

* Fix the error fo manually_build_for_testing.yml.
 2022-11-10 17:32:00 +08:00