ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
2666 commits 1 branch 0 tags 37 MiB
Commit graph

2 commits

Author SHA1 Message Date
Guancheng Fu
47bd5f504c
[vLLM]Remove vllm-v1, refactor v2 (#10842) 
* remove vllm-v1

* fix format
 2024-04-22 17:51:32 +08:00
Guancheng Fu
cbe7b5753f
Add vLLM[xpu] related code (#10779) 
* Add ipex-llm side change

* add runable offline_inference

* refactor to call vllm2

* Verified async server

* add new v2 example

* add README

* fix

* change dir

* refactor readme.md

* add experimental

* fix
 2024-04-18 15:29:20 +08:00