ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
3694 commits 1 branch 0 tags 37 MiB
Commit graph

3 commits

Author SHA1 Message Date
SONG Ge
d2cbcb060c
Add initial support for modeling_xlm encoder on NPU (#12393) 
* Add initial support for modeling_xlm encoder on NPU

* Add EmbeddingModel class to keep the same usage with bce and npu fp16 linear convert

* Optimize currently implementation to support EmbeddingModel.encode API and convert other torch modules to NPU

* Add related example and documents
 2024-11-14 10:50:27 +08:00
SONG Ge
a7b66683f1
[NPU] Add Optimized Support for Llama3.2-1B/3B on NPU (#12339) 
* Add initial support for llama3.2-1b/3b

* move llama3.2 support into current llama_mp impl
 2024-11-06 19:21:40 +08:00
SONG Ge
a0c6432899
[NPU] Add support for loading a FunASR model (#12073) 
* add support for loading funasr model

* add initial support for paraformer-encoder

* add npu ops impl

* add encoder-decoder npu pipeline

* move paraformer encoders prefix 30 layers  to npu and keep the rest layers on cpu
 2024-10-25 17:22:01 +08:00