ipex-llm/python
Guancheng Fu 2d930bdca8 Add vLLM bf16 support (#10278)
* add argument load_in_low_bit

* add docs

* modify gpu doc

* done

---------

Co-authored-by: ivy-lv11 <lvzc@lamda.nju.edu.cn>
2024-02-29 16:33:42 +08:00
..
llm Add vLLM bf16 support (#10278) 2024-02-29 16:33:42 +08:00