ipex-llm/python/llm/src/ipex_llm/serving
Guancheng Fu 0ee54fc55f
Upgrade to vllm 0.6.2 (#12338)
* Initial updates for vllm 0.6.2

* fix

* Change Dockerfile to support v062

* Fix

* fix examples

* Fix

* done

* fix

* Update engine.py

* Fix Dockerfile to original path

* fix

* add option

* fix

* fix

* fix

* fix

---------

Co-authored-by: xiangyuT <xiangyu.tian@intel.com>
2024-11-12 20:35:34 +08:00
..
fastapi Support lightweight-serving glm-4v-9b (#11994) 2024-09-05 09:25:08 +08:00
fastchat Upgrade to vllm 0.6.2 (#12338) 2024-11-12 20:35:34 +08:00
__init__.py Refactor bigdl.llm to ipex_llm (#24) 2024-03-22 15:41:21 +08:00