Zhao Changmin
|
06745e5742
|
Add npu benchmark all-in-one script (#11571)
* npu benchmark
|
2024-07-15 10:42:37 +08:00 |
|
Yishuo Wang
|
019da6c0ab
|
use mlp silu_mul fusion in qwen2 to optimize memory usage (#11574)
|
2024-07-13 16:32:54 +08:00 |
|
Xu, Shuo
|
13a72dc51d
|
Test MiniCPM performance on iGPU in a more stable way (#11573)
* Test MiniCPM performance on iGPU in a more stable way
* small fix
---------
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
|
2024-07-12 17:07:41 +08:00 |
|
Xiangyu Tian
|
0981b72275
|
Fix /generate_stream api in Pipeline Parallel FastAPI (#11569)
|
2024-07-12 13:19:42 +08:00 |
|
Yishuo Wang
|
a945500a98
|
fix internlm xcomposser stream chat (#11564)
|
2024-07-11 18:21:17 +08:00 |
|
Zhao Changmin
|
b9c66994a5
|
add npu sdp (#11562)
|
2024-07-11 16:57:35 +08:00 |
|
binbin Deng
|
2b8ad8731e
|
Support pipeline parallel for glm-4v (#11545)
|
2024-07-11 16:06:06 +08:00 |
|
Xiangyu Tian
|
7f5111a998
|
LLM: Refine start script for Pipeline Parallel Serving (#11557)
Refine start script and readme for Pipeline Parallel Serving
|
2024-07-11 15:45:27 +08:00 |
|
Xu, Shuo
|
1355b2ce06
|
Add model Qwen-VL-Chat to iGPU-perf (#11558)
* Add model Qwen-VL-Chat to iGPU-perf
* small fix
---------
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
|
2024-07-11 15:39:02 +08:00 |
|
Zhao Changmin
|
105e124752
|
optimize phi3-v encoder npu performance and add multimodal example (#11553)
* phi3-v
* readme
|
2024-07-11 13:59:14 +08:00 |
|
Cengguang Zhang
|
70ab1a6f1a
|
LLM: unify memory optimization env variables. (#11549)
* LLM: unify memory optimization env variables.
* fix comments.
|
2024-07-11 11:01:28 +08:00 |
|
Wang, Jian4
|
51f2effb05
|
Add xpu-tgi manually_build (#11556)
|
2024-07-11 10:35:40 +08:00 |
|
Xu, Shuo
|
028ad4f63c
|
Add model phi-3-vision-128k-instruct to iGPU-perf benchmark (#11554)
* try to improve MIniCPM performance
* Add model phi-3-vision-128k-instruct to iGPU-perf benchmark
---------
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
|
2024-07-10 17:26:30 +08:00 |
|
Yishuo Wang
|
994e49a510
|
optimize internlm xcomposser performance again (#11551)
|
2024-07-10 17:08:56 +08:00 |
|
Xu, Shuo
|
61613b210c
|
try to improve MIniCPM performance (#11552)
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
|
2024-07-10 16:58:23 +08:00 |
|
Yishuo Wang
|
82f9514303
|
optimize internlm xcomposer2 performance (#11550)
|
2024-07-10 15:57:04 +08:00 |
|
Zhao Changmin
|
3c16c9f725
|
Optimize baichuan on NPU (#11548)
* baichuan_npu
|
2024-07-10 13:18:48 +08:00 |
|
Yuwen Hu
|
8982ab73d5
|
Add Yi-6B and StableLM to iGPU perf test (#11546)
* Add transformer4.38.2 test to igpu benchmark (#11529)
* add transformer4.38.1 test to igpu benchmark
* use transformers4.38.2 & fix csv name error in 4.38 workflow
* add model Yi-6B-Chat & remove temporarily most models
---------
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
* filter some errorlevel (#11541)
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
* Restore the temporarily removed models in iGPU-perf (#11544)
* filter some errorlevel
* restore the temporarily removed models in iGPU-perf
---------
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
---------
Co-authored-by: Xu, Shuo <100334393+ATMxsp01@users.noreply.github.com>
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
|
2024-07-09 18:51:23 +08:00 |
|
Yishuo Wang
|
7dc6756d86
|
add disk embedding (#11543)
|
2024-07-09 17:38:40 +08:00 |
|
Zhao Changmin
|
76a5802acf
|
update NPU examples (#11540)
* update NPU examples
|
2024-07-09 17:19:42 +08:00 |
|
Yishuo Wang
|
99b2802d3b
|
optimize qewn2 memory (#11535)
|
2024-07-09 17:14:01 +08:00 |
|
Yishuo Wang
|
2929eb262e
|
support npu glm4 (#11539)
|
2024-07-09 15:46:49 +08:00 |
|
Xiangyu Tian
|
a1cede926d
|
Fix update_kv_cache in Pipeline-Parallel-Serving for glm4-9b model (#11537)
|
2024-07-09 14:08:04 +08:00 |
|
Cengguang Zhang
|
fa81dbefd3
|
LLM: update multi gpu write csv in all-in-one benchmark. (#11538)
|
2024-07-09 11:14:17 +08:00 |
|
Xin Qiu
|
69701b3ec8
|
fix typo in python/llm/scripts/README.md (#11536)
|
2024-07-09 09:53:14 +08:00 |
|
Jason Dai
|
099486afb7
|
Update README.md (#11530)
|
2024-07-08 20:18:41 +08:00 |
|
binbin Deng
|
66f6ffe4b2
|
Update GPU HF-Transformers example structure (#11526)
|
2024-07-08 17:58:06 +08:00 |
|
Xu, Shuo
|
f9a199900d
|
add model RWKV/v5-Eagle-7B-HF to igpu benchmark (#11528)
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
|
2024-07-08 15:50:16 +08:00 |
|
Shaojun Liu
|
9b37ca6027
|
remove (#11527)
|
2024-07-08 15:49:52 +08:00 |
|
Yishuo Wang
|
c26651f91f
|
add mistral npu support (#11523)
|
2024-07-08 13:17:15 +08:00 |
|
Jun Wang
|
5a57e54400
|
[ADD] add 5 new models for igpu-perf (#11524)
|
2024-07-08 11:12:15 +08:00 |
|
Xu, Shuo
|
64cfed602d
|
Add new models to benchmark (#11505)
* Add new models to benchmark
* remove Qwen/Qwen-VL-Chat to pass the validation
---------
Co-authored-by: ATMxsp01 <shou.xu@intel.com>
|
2024-07-08 10:35:55 +08:00 |
|
binbin Deng
|
252426793b
|
Fix setting of use_quantize_kv_cache on different GPU in pipeline parallel (#11516)
|
2024-07-08 09:27:01 +08:00 |
|
Yishuo Wang
|
7cb09a8eac
|
optimize qwen2 memory usage again (#11520)
|
2024-07-05 17:32:34 +08:00 |
|
Yuwen Hu
|
8f376e5192
|
Change igpu perf to mainly test int4+fp16 (#11513)
|
2024-07-05 17:12:33 +08:00 |
|
Jun Wang
|
1efb6ebe93
|
[ADD] add transformer_int4_fp16_loadlowbit_gpu_win api (#11511)
* [ADD] add transformer_int4_fp16_loadlowbit_gpu_win api
* [UPDATE] add int4_fp16_lowbit config and description
* [FIX] fix run.py mistake
* [FIX] fix run.py mistake
* [FIX] fix indent; change dtype=float16 to model.half()
|
2024-07-05 16:38:41 +08:00 |
|
Zhao Changmin
|
f7e957aaf9
|
Clean npu dtype branch (#11515)
* clean branch
* create_npu_kernels
|
2024-07-05 15:45:26 +08:00 |
|
Yishuo Wang
|
14ce058004
|
add chatglm3 npu support (#11518)
|
2024-07-05 15:31:27 +08:00 |
|
Xin Qiu
|
a31f2cbe13
|
update minicpm.py (#11517)
* update minicpm
* meet code review
|
2024-07-05 15:25:44 +08:00 |
|
Zhao Changmin
|
24de13fc45
|
Optimize stablelm on NPU (#11512)
* stablelm_optimize
|
2024-07-05 14:21:57 +08:00 |
|
Xiangyu Tian
|
7d8bc83415
|
LLM: Partial Prefilling for Pipeline Parallel Serving (#11457)
LLM: Partial Prefilling for Pipeline Parallel Serving
|
2024-07-05 13:10:35 +08:00 |
|
Shaojun Liu
|
72b4efaad4
|
Enhanced XPU Dockerfiles: Optimized Environment Variables and Documentation (#11506)
* Added SYCL_CACHE_PERSISTENT=1 to xpu Dockerfile
* Update the document to add explanations for environment variables.
* update quickstart
|
2024-07-04 20:18:38 +08:00 |
|
binbin Deng
|
60de428b37
|
Support pipeline parallel for qwen-vl (#11503)
|
2024-07-04 18:03:57 +08:00 |
|
Zhao Changmin
|
57b8adb189
|
[WIP] Support npu load_low_bit method (#11502)
* npu_load_low_bit
|
2024-07-04 17:15:34 +08:00 |
|
Jun Wang
|
f07937945f
|
[REMOVE] remove all useless repo-id in benchmark/igpu-perf (#11508)
|
2024-07-04 16:38:34 +08:00 |
|
Yishuo Wang
|
1a8bab172e
|
add minicpm 1B/2B npu support (#11507)
|
2024-07-04 16:31:04 +08:00 |
|
Yishuo Wang
|
bb0a84044b
|
add qwen2 npu support (#11504)
|
2024-07-04 11:01:25 +08:00 |
|
Shaojun Liu
|
932ef78131
|
Update Workflow Inputs, Runner, and PR Validation Process (#11501)
* update check-artifact runner label to Shire
* update github.event.inputs to inputs
* update PR template
|
2024-07-03 16:49:54 +08:00 |
|
Xin Qiu
|
f84ca99b9f
|
optimize gemma2 rmsnorm (#11500)
|
2024-07-03 15:21:03 +08:00 |
|
Wang, Jian4
|
61c36ba085
|
Add pp_serving verified models (#11498)
* add verified models
* update
* verify large model
* update commend
|
2024-07-03 14:57:09 +08:00 |
|