5 commits

Author	SHA1	Message	Date
Chen, Zhentao	d19ca21957	patch bigdl-llm model to harness by binding instead of patch file (#9420) ... * add run_llb.py * fix args interpret * modify outputs * update workflow * add license * test mixed 4 bit * update readme * use autotokenizer * add timeout * refactor workflow file * fix working directory * fix env * throw exception if some jobs failed * improve terminal outputs * Disable var which cause the run stuck * fix unknown precision * fix key error * directly output config instead * rm harness submodule	2023-11-14 12:51:39 +08:00
Chen, Zhentao	0ecb9efb05	use AutoTokenizer to enable more models (#9446)	2023-11-13 17:47:43 +08:00
Chen, Zhentao	5747e2fe69	fix multiple gpu usage of harness (#9444)	2023-11-13 16:53:23 +08:00
Chen, Zhentao	298b64217e	add auto triggered acc test (#9364) ... * add auto triggered acc test * use llama 7b instead * fix env * debug download * fix download prefix * add cut dirs * fix env of model path * fix dataset download * full job * source xpu env vars * use matrix to trigger model run * reset batch=1 * remove redirect * remove some trigger * add task matrix * add precision list * test llama-7b-chat * use /mnt/disk1 to store model and datasets * remove installation test * correct downloading path * fix HF vars * add bigdl-llm env vars * rename file * fix hf_home * fix script path * rename as harness evalution * rerun	2023-11-08 10:22:27 +08:00
Chen, Zhentao	d4dffbdb62	Merge harness (#9319) ... * add harness patch and llb script * add readme * add license * use patch instead * update readme * rename tests to evaluation * fix typo * remove nano dependency * add original harness link * rename title of usage * rename BigDLGPULM as BigDLLM * empty commit to rerun job	2023-11-02 15:14:19 +08:00