ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
3260 commits 1 branch 0 tags 37 MiB
Commit graph

433 commits

Author SHA1 Message Date
Song Jiaming
411d896636 LLM first transformers UT (#8514) 
* ut

* transformers api first ut

* name

* dir issue

* use chatglm instead of chatglm2

* omp

* set omp in sh

* source

* taskset

* test

* test omp

* add test
 2023-07-20 10:16:27 +08:00
Yishuo Wang
3bd1420b71 LLM: use MSVC to build avx-vnni binary files (#8570) 2023-07-19 17:38:14 +08:00
Guancheng Fu
4f287df664 Fix manullay_build_for_testing (#8556) 2023-07-18 16:21:39 +08:00
Guancheng Fu
3e0e370898 [PPML] Add bigdl-llm-demo dependencies to TDX image (#8551) 
* add bigdl-llm-demo dependencies to tdx image

* use only one RUN command

* Add bigdl-ppml

* done
 2023-07-18 14:23:07 +08:00
xingyuan li
c87853233b [LLM] Add windows vnni binary build step (#8518) 
* add windows vnni build step
* update build info
* add download command
 2023-07-14 17:24:39 +09:00
xingyuan li
903e9aee7a Fix the problem of workflow cancellation after pr merge (#8530) 
* remove concurrency group for llm binary build workflow
 2023-07-14 16:12:21 +09:00
Yuwen Hu
df97d39e29 Change thread_num in Linux inference actions (#8528) 2023-07-14 10:46:03 +08:00
xingyuan li
60c2c0c3dc Bug fix for merged pr #8503 (#8516) 2023-07-13 17:26:30 +09:00
xingyuan li
4f152b4e3a [LLM] Merge the llm.cpp build and the pypi release (#8503) 
* checkout llm.cpp to build new binary
* use artifact to get latest built binary files
* rename quantize
* modify all release workflow
 2023-07-13 16:34:24 +09:00
xingyuan li
04f2f04410 Add workflow_dispatch for llm unittest workflow (#8485) 2023-07-10 13:16:18 +08:00
Guancheng Fu
a4ae132ef4 Add bigdl llm sgx image (#8480) 
* Add dockerfile for bigdl-llm-ppml

* fix llm-cli multi-process

* add workflow
 2023-07-10 10:10:38 +08:00
Wang Jian
16c795158d [PPML] Pull new deep-learning base image before build (#8469) 
* pull new base image before build

* update
 2023-07-06 14:29:09 +08:00
Yuwen Hu
936d21635f [LLM] Extract tests to .github/actions to improve reusability (#8457) 
* Extract tests to .github/actions for better reusing in nightly tests

* Small fix

* Small fix
 2023-07-05 10:09:10 +08:00
Guancheng Fu
e3e95e92ca Add workflow for releasing TDX bigdl-llm image (#8455) 2023-07-04 17:00:29 +08:00
Yuwen Hu
372c775cb4 [LLM] Change default runner for LLM Linux tests to the ones with AVX512 (#8448) 
* Basic change for AVX512 runner

* Remove conda channel and action rename

* Small fix

* Small fix and reduce peak convert disk space

* Define n_threads based on runner status

* Small thread num fix

* Define thread_num for cli

* test

* Add self-hosted label and other small fix
 2023-07-04 14:53:03 +08:00
binbin Deng
146662bc0d LLM: fix langchain windows failure (#8417) 2023-06-30 09:59:10 +08:00
Yina Chen
6251ad8934 [LLM]Windows unittest (#8356) 
* win-unittest

* update

* update

* try llama 7b

* delete llama

* update

* add red-3b

* only test red-3b

* revert

* add langchain

* add dependency

* delete langchain
 2023-06-29 14:03:12 +08:00
Ruonan Wang
4be784a49d LLM: add UT for starcoder (convert, inference) update examples and readme (#8379) 
* first commit to add path

* update example and readme

* update path

* fix

* update based on comment
 2023-06-27 12:12:11 +08:00
Shengsheng Huang
c113ecb929 [LLM] langchain bloom, UT's, default parameters (#8357) 
* update langchain default parameters to align w/ api

* add ut's for llm and embeddings

* update inference test script to install langchain deps

* update tests workflows

---------

Co-authored-by: leonardozcm <changmin.zhao@intel.com>
 2023-06-25 17:38:00 +08:00
Yuwen Hu
066f53232d [LLM] Small nightly tests fix (#8364) 
* Test for install of tnftp

* Improve install of tnftp
 2023-06-20 11:19:13 +08:00
binbin Deng
ab1a833990 LLM: add basic uts related to inference (#8346) 2023-06-19 10:25:51 +08:00
xingyuan li
daae7bd4e4 [LLM] Unittest for llm-cli (#8343) 
* add llm-cli test shell
 2023-06-16 17:42:24 +08:00
Yuwen Hu
1aa33d35d5 [LLM] Refactor LLM Linux tests (#8349) 
* Small name fix

* Add convert nightly tests, and for other llm tests, use stable ckpt

* Small fix and ftp fix

* Small fix

* Small fix
 2023-06-16 15:22:48 +08:00
Yuwen Hu
50dd9dd1c5 [LLM] Small improve for LLM base actions (#8344) 
* Hide ftp url for now

* Small file name fix
 2023-06-15 16:22:41 +08:00
Yuwen Hu
b30aa49c4e [LLM] Add Actions for downloading & converting models (#8320) 
* First push to downloading and converting llm models for testing (Gondolin runner, avx2 for now)

* Change yml file name
 2023-06-15 13:43:47 +08:00
Ruonan Wang
8840dadd86 LLM: binary file version control on source forge (#8329) 
* support version control for llm based on date

* update action
 2023-06-15 09:53:27 +08:00
Pingchuan Ma (Henry)
773255e009 [LLM] Add dev wheel building and basic UT script for LLM package on Linux (#8264) 
* add wheel build for linux

* test fix

* test self-hosted runner

* test fix

* update runner

* update runner

* update fix

* init cicd

* init cicd

* test conda

* update fix

* update no need manual python deps

* test fix bugs

* test fix bugs

* test fix bugs

* fix bugs
 2023-06-08 00:49:57 +08:00
Pingchuan Ma (Henry)
2ed5842448 [LLM] add convert's python deps for LLM (#8260) 
* add python deps for LLM

* update release.sh

* change deps group name

* update all

* fix update

* test fix

* update
 2023-06-06 16:01:17 +08:00
Pingchuan Ma (Henry)
c48d5f7cff [LLM] Enable UT workflow logics for LLM (#8243) 
* check push connection

* enable UT workflow logics for LLM

* test fix

* add licenses

* test fix according to suggestions

* test fix

* update changes
 2023-06-02 17:06:35 +08:00
Pingchuan Ma (Henry)
141febec1f Add dev wheel building script for LLM package on Windows (#8238) 
* Add dev wheel building script for LLM package on Windows

* delete conda

* delete python version check

* minor adjust

* wheel name fixed

* test check

* test fix

* change wheel name
 2023-06-01 11:55:26 +08:00
Shaojie Cui
768b15881d [PPML]CICD: build 32g bigdata image (#8205) 
* [PPML]CICD: build 32g bigdata image

* fix
 2023-05-17 11:30:10 +08:00
Xiangyu Tian
94f08edbb3 [PPML] Refactor BigDL Attestation Service Deployment of Docker and K8s (#8130) 
Refactor BigDL Attestation Service Deployment of Docker image, which split to base image and custom(reference) image.
Update version to 2.4.0-SNAPSHOT.
Refine documents.
 2023-04-26 14:28:00 +08:00
Yao Li
d833a765fe update manually build (#8129) 2023-04-24 16:08:56 +08:00
Yao Li
8719674c92 update manually_build.yml (#8126) 2023-04-24 15:29:24 +08:00
Le-Zheng
8b0876f238 add tdx image in action (#8125) 
* add tdx image in action

* update

* Update manually_build.yml

* update Readme
 2023-04-24 14:37:14 +08:00
Yao Li
f30215a77e delete outdated bigdl kms (#8115) 2023-04-23 15:45:55 +08:00
Yao Li
981bded4b3 fix bigdl-kms-reference (#8110) 2023-04-23 14:08:53 +08:00
Yao Li
c7630f759a [PPML] Add bigdl-kms into manually build (#8105) 
* update readme

* update manually_build.yml

* Update manually_build.yml

* fix format

* udpate

* update
 2023-04-23 11:51:00 +08:00
Wang Jian
96c9343ef2 [PPML] Update occlum production image build dir (#8098) 2023-04-21 11:46:42 +08:00
Heyang Sun
814f5bd915 add no_proxy for bigdl-kms (#7996) 2023-04-06 09:18:53 +08:00
Shaojie Cui
f885466475 [CICD]fix: typo in build (#7990) 2023-04-04 14:30:44 +08:00
Shaojie Cui
8a24ae76a8 [CICD]fix image name in bigdata toolkit (#7978) 2023-04-03 15:57:27 +08:00
Heyang Sun
e91cb31575 set no (#7974) 2023-04-03 09:02:43 +08:00
Shaojie Cui
13717ee5c8 [CICD]add noattest bigdata toolkit image (#7968) 2023-03-31 14:02:08 +08:00
Shaojie Cui
522e5ae35b [CICD]add no_proxy arg when building bigdata (#7868) 
* [CICD]add no_proxy arg when building bigdata

* fix
 2023-03-14 16:34:52 +08:00
Shaojie Cui
57125dfcd4 [PPML]tag 8g epc bigdata as default image (#7789) 
* build 4g and tag 8g as latest

* reduce script memory

* doc
 2023-03-08 10:49:40 +08:00
Shaojie Cui
f0fa26a8a8 [PPML]Reduce the epc usage of bigdata (#7606) 
* build bigdata with smaller epc

* reduce epc in script

* fix action

* install pyarrow

* delete unused part

* reduce epc

* fix

* malloc_arena_max

* set 16g to default and delete 4g

* unused example

* spark simplequery

* pyspark simplequery

* fix

* fix

* fix

* code style fix
 2023-03-01 14:59:27 +08:00
Guancheng Fu
3a57b97c2b Add dl-serving manually_build workflow (#7719) 2023-03-01 11:05:57 +08:00
Shaojie Cui
feacade38c [CICD]fix: delete latest tag bigdata image built for testing (#7701) 2023-02-27 17:01:22 +08:00
Shaojie Cui
b12f2e1902 [CICD]delete bigdata image with debug log level (#7657) 2023-02-23 09:53:06 +08:00
Shaojie Cui
e5fb0a3315 [CICD]build bigdata toolkit with no cache (#7652) 2023-02-22 16:32:28 +08:00
Guancheng Fu
3adcb84e24 Update dl-serving-gramine-ref workflow 2023-02-17 13:48:45 +08:00
Guancheng Fu
de1ec0d19b Update workflow for dl-serving gramine-ref 2023-02-17 13:43:31 +08:00
Guancheng Fu
842e676ad7 adding new workflow for dl-serving image (#7595) 2023-02-17 10:29:20 +08:00
Shaojie Cui
ec2b9c13ee [CICD]add bigdata toolkit with debug log level (#7564) 2023-02-15 20:16:17 +08:00
Heyang Sun
192a4d4c68 fix variable typo (#7543) 2023-02-14 17:18:20 +08:00
Shaojie Cui
670c54c6d7 [PPML]fix:add image with tag 'latest' in private dockerfile (#7441) 2023-02-06 23:01:16 +08:00
Heyang Sun
338423bfc9 Add bigdl-kms image build action 2023-01-11 09:42:30 +08:00
Shaojie Cui
3e040d7b28 [PPML]refactor bigdata build (#7088) 2022-12-26 13:49:59 +08:00
Heyang Sun
7c3d2b835d add 16G reference gramine images 2022-12-26 09:30:42 +08:00
Wang Jian
b82975a8d1 [PPML] Update customer image readme (#6859) 
* push no build production image

* init build.sh

* update

* update path

* update rm order

* update path

* update readme

* update
 2022-12-02 16:45:30 +08:00
Xiangyu Tian
cd8d21dded Fix docker rmi in manually_build (#6716) 2022-11-23 13:44:48 +08:00
Wang Jian
229302b758 Update occlum register path (#6709) 2022-11-22 10:47:52 +08:00
Guancheng Fu
1b72f1b38f [PPML] Upgrade PyTorch version to 1.13.0 (#6638) 
* Make gramine to generate patched OpenMP

* cp libgomp to /usr/local/lib/

* Move gopenmp to a different place

* add patch to use gramine version openmp

* Change base Dockerfile

* Applying optimization recommended by PyTorch tutorial

* Ready for test pert_ipex.py

* remove extra space

* Fix dockerfile to use PyTorch 1.13.0

* Pin markupsafe to 2.0.1 after installing bigdl-nano, may need changes?

* Change test workflow
 2022-11-21 20:02:30 +08:00
Wang Jian
8f18a235fd Occlum customer image build action no cache (#6674) 2022-11-18 11:27:27 +08:00
Shaojie Cui
aff0f55b7f fix: add var base_image in bigdata build (#6616) 2022-11-15 16:31:33 +08:00
Shaojie Cui
f1d4fb4d37 cicd:add option bigdl-ppml-trusted-bigdata-gramine (#6615) 2022-11-15 16:19:43 +08:00
Heyang Sun
dabea499ff fix kmsutils action bug 2022-11-14 16:05:33 +08:00
Heyang Sun
2d7ea756af fix occlum-customer 2022-11-14 16:01:51 +08:00
Wang Jian
348c6aa092 [PPML] Add occlum manually customer image action build (#6588) 
* fix no word '\'

* add manually customer image build action

* update build path
 2022-11-14 13:47:17 +08:00
Wang Jian
da7d065495 [PPML] Add customer image action selection (#6587) 2022-11-14 13:17:13 +08:00
Wang Jian
67a8082a4f [PPML] Add customer action test (#6586) 
* add customer build test

* add start -e runtime env
 2022-11-14 13:07:57 +08:00
Jin Hanyu
93351ffd0a Add python toolkit image to manually_build.yml. (#6581) 2022-11-14 10:42:45 +08:00
Wang Jian
a9c3c18108 [PPML] Split occlum build and run for production (#6522) 
* add mount.sh to mount k8s runtime config

* add mount conf and mkdir mount path

* run.sh init

* entrypoint bash mount

* init bash add_conf.sh

* init dockerfile

* dockerfile add ../file

* add mount.sh and add_conf.sh to dockerfile

* move register and attest

* docker and k8s mount and attest

* occlum-build.sh init

* update default name

* default attest and enable sgx debug

* add move files

* change ../ tp .

* Revert "no"

This reverts commit bd09e193e47c2ed72b10299126df5bcc7784f3da.

* update build image dir

* update build spell

* -it to -i

* update production manually build

* update manually push image name

* update register error message
 2022-11-11 14:12:42 +08:00
Jin Hanyu
935b272c9f Add SGX_LOG_LEVEL to manually_build_for_testing. (#6558) 
* Add SGX_LOG_LEVEL to manually_build_for_testing.
 2022-11-11 12:57:56 +08:00
Jin Hanyu
2ecf8c5108 Add SGX_LOG_LEVEL to bigdl_ppml_trusted_python_toolkit. (#6557) 
* Add SGX_LOG_LEVEL to bigdl_ppml_trusted_python_toolkit.
 2022-11-11 12:10:39 +08:00
Wang Jian
71177c3f5d [PPML] Update manually push image name (#6555) 2022-11-11 11:11:53 +08:00
Jin Hanyu
65796ac9e7 Modify the directory of bigdl-ppml-python-toolkit in manually_build_for_testing. (#6553) 
* Modify the directory of bigdl-ppml-python-toolkit in manually_build_for_testing.
 2022-11-11 10:20:24 +08:00
Jin Hanyu
d5cbc8e5b7 [BugFix] Fix the error of lacking indents. (#6552) 
* [BugFix] Fix the error of lacking indents.
 2022-11-11 09:50:07 +08:00
Jin Hanyu
db5791fecb [BugFix] Fix syntax error of manually_build_for_testing. (#6545) 
* Build python toolkit image in manually build for test.

* Correct the name of image in options and job.

* Fix the error fo manually_build_for_testing.yml.
 2022-11-10 17:32:00 +08:00
Jin Hanyu
25d01a16b5 Build python toolkit image in manually build for test. (#6542) 
* Build python toolkit image in manually build for test.

* Correct the name of image in options and job.
 2022-11-10 17:04:30 +08:00
Wang Jian
bd073e940a [PPML] Update manually build work dir (#6540) 
* update manually build work dir

* container name remove /
 2022-11-10 15:56:48 +08:00
Wang Jian
9b472e80f2 [PPML] Build image Action use cache and update production build (#6532) 2022-11-10 13:47:03 +08:00
Wang Jian
2fcf2e1fd5 [PPML] Update occlum production build (#6526) 2022-11-10 11:04:08 +08:00
Heyang Sun
7302451234 add debug image for azure 2022-11-08 16:39:29 +08:00
Heyang Sun
8b41130ca0 add 16g gramine image 2022-11-08 15:14:13 +08:00
Heyang Sun
ff69b05616 Update manually_build.yml 2022-11-08 15:06:05 +08:00
Heyang Sun
f9f2b9614b fix bug 2022-11-04 12:00:06 +08:00
Heyang Sun
5c5066b2c0 add debug log level image in noattest 2022-11-04 11:44:56 +08:00
Heyang Sun
1497bde87a add debug log level gramine images 2022-11-04 10:17:26 +08:00
Heyang Sun
d911f89b8d add debug log level image 2022-11-04 10:16:50 +08:00
Heyang Sun
23d79f7b7b Update manually_build.yml 2022-11-02 12:13:35 +08:00
Heyang Sun
1aa0be32ff set no-attest flag in image build console 2022-10-31 14:37:22 +08:00
Heyang Sun
ed3cc9ed64 set no-attest flag in image build console 2022-10-31 14:34:39 +08:00
Shaojie Cui
13f2557785 [PPML]CI/CD: build 64g Bigdata Toolkit (#6348) 2022-10-28 14:51:24 +08:00
Shaojun Liu
3751a1134c remove default value for commit id (#6338) 2022-10-28 08:43:09 +08:00
Shaojun Liu
7edf650344 [ppml]: create a workflow for ppml developer to build image based on specific commit id (#6334) 
* Create manually_build_for_testing.yml

* Update manually_build_for_testing.yml

* Update manually_build_for_testing.yml

* Update manually_build_for_testing.yml
 2022-10-28 08:37:40 +08:00
Guancheng Fu
97b5c6a813 [PPML] fix mnist.py (#6320) 
* fix mnist.py

* Add default SGX_LOG_LEVEL to error in workflow
 2022-10-27 11:14:14 +08:00
Guancheng Fu
8a15a79b1a [PPML] Modify image to support pert model (#6293) 2022-10-26 11:48:48 +08:00
Shaojie Cui
6e32cfc215 [PPML]add gramine bigdata toolkit (#6135) 
* java scala spark hadoop hive

* flink

* tmp copy

* bigdata toolkit

* change image tag

* change build script

* typo

* add log4j2.xml

* change https to http

* fix

* exchange location of spark and flink

* add maven proxy

* change proxy name

* update settings

* add scala version arg

* add submit.sh

* delete test script

* change home and add dependencies

* add custom images

* fix

* add sgx related files

* path change

* arg move

* move unused env and directory

* remove scala

* remove settings

* upgrade spark

* delete settings

* delete work directory

* modify path

* remove java

* remove java in first stage

* readd jdk in first stage

* fix

* build base image script

* add readme

* remove flink

* fix

* remove unused env

* CI/CD

* trigger test

* Trigger test

* fix proxy

* enable non-privilege

* remove directories in level 1

* change resuorces

* remove test code

* change resources limits
 2022-10-25 09:44:34 +08:00
Heyang Sun
70468a96c6 Fix ra config 2022-10-22 20:32:06 +08:00
Heyang Sun
f7e07ecc69 add no-attestation gramine images 2022-10-21 16:20:30 +08:00
shaojie
57493194e7 fixed docker push image (#6235) 2022-10-21 10:44:31 +08:00
shaojie
a1e9b41c3e tag reference-32g-error:2.2.0-SNAPSHOT to reference-32g:latest (#6226) 
* tag reference-32g-error:2.2.0-SNAPSHOT to reference-32g:latest

* update weekly_test default image
 2022-10-20 20:27:25 +08:00
Heyang Sun
4bea11d5e8 rename gramine images 2022-10-20 13:24:35 +08:00
Guancheng Fu
8ddc5d9829 [CICD] fix missing "\" issue in workflow 
Add missing "\" in github workflow
 2022-10-20 10:00:33 +08:00
Guancheng Fu
396fde454d Fix workflow path issue (#6209) 2022-10-20 09:56:52 +08:00
Guancheng Fu
4043e361fc [CICD] Add workflow to build trusted-deep-learning-gramine-ref image (#6208) 
* Add workflow to build trusted-deep-learning-gramine-ref image

* Add options
 2022-10-20 09:24:25 +08:00
Guancheng Fu
4fe2e381ec Update manually_build.yml (#6195) 2022-10-19 14:47:17 +08:00
Guancheng Fu
b688238068 [PPML] Fix error path in trusted-dl-gramine-base (#6194) 2022-10-19 14:38:29 +08:00
Guancheng Fu
a0d6f860b8 Add build script for trusted-dl-base (#6193) 2022-10-19 14:28:33 +08:00
Guancheng Fu
6624bd1c2c [PPML WORKFLOW] Add build script for bigdl-ppml-gramine-base image (#6191) 
* Add build script for bigdl-ppml-gramine-base image

* Remove image at last
 2022-10-19 13:48:11 +08:00
Shaojie Cui
606ef2f9f6 [PPML]build gramine image with all log (#6123) 2022-10-14 10:51:34 +08:00
Heyang Sun
543e06b710 Update manually_build.yml 2022-10-13 09:39:00 +08:00
Heyang Sun
b31d73ca31 Update manually_build.yml 2022-10-12 16:26:12 +08:00
Heyang Sun
38635d204b Update manually_build.yml 2022-10-12 15:08:50 +08:00
Heyang Sun
6e9450bb9e Update manually_build.yml 2022-10-12 14:51:52 +08:00
Heyang Sun
12330ebb7a Update manually_build.yml 2022-10-12 14:51:17 +08:00
Heyang Sun
4dac2606ad Update manually_build.yml 2022-10-12 14:48:13 +08:00
Heyang Sun
d8d4a05916 Update manually_build.yml 2022-10-12 14:46:36 +08:00
Heyang Sun
fc3fb94e23 push base image as well 2022-10-12 13:59:01 +08:00
Heyang Sun
0e94e70b85 Rename base image name in docker build command 2022-10-12 13:19:26 +08:00
Heyang Sun
6140b81eab unannotated docker push 2022-10-11 15:42:24 +08:00
Heyang Sun
fb0f9a35b9 delete enclave key after build 2022-10-11 10:38:29 +08:00
Heyang Sun
53b9f8d958 add new gramine image build action 2022-10-11 10:37:00 +08:00
Wang Jian
a74d08b52b [PPML] Add Occlum-production to github action (#5976) 2022-09-27 16:00:05 +08:00
Dongjie Shi
bff6795199 update action to publish images (#5966) 2022-09-26 17:27:11 +08:00
Shaojun Liu
d4338f3b53 fix issues (#5539) 2022-08-25 16:33:31 +08:00
Shaojun Liu
bc986f1500 cicd: refactor the github actions workflows (#5529) 
* add composite actions

* add manually build
 2022-08-25 15:58:34 +08:00
Dongjie Shi
dcd80805f4 Update CODEOWNERS 2022-08-18 16:22:14 +08:00
Dongjie Shi
6cc1ffd521 add CODEOWNERS (#5198) 2022-07-26 10:22:40 +08:00
Jason Dai
3496f58575 Update PR template (#5136) 2022-07-20 10:07:46 +08:00
Jason Dai
3916d11780 PR template (#5093) 
Add Github PR template
 2022-07-13 17:51:28 +08:00