ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/src/ipex_llm/vllm
History
Guancheng Fu 990535b1cf
Add tensor parallel for vLLM (#10879) 
* initial

* test initial tp

* initial sup

* fix format

* fix

* fix
2024-04-26 17:10:49 +08:00
..
engine Add tensor parallel for vLLM (#10879) 2024-04-26 17:10:49 +08:00
entrypoints/openai [vLLM]Remove vllm-v1, refactor v2 (#10842) 2024-04-22 17:51:32 +08:00
__init__.py [vLLM]Remove vllm-v1, refactor v2 (#10842) 2024-04-22 17:51:32 +08:00
ipex_llm_gpu_executor.py Add tensor parallel for vLLM (#10879) 2024-04-26 17:10:49 +08:00
model_convert.py [vLLM]Remove vllm-v1, refactor v2 (#10842) 2024-04-22 17:51:32 +08:00