Guancheng Fu 2d930bdca8 Add vLLM bf16 support (#10278) ... * add argument load_in_low_bit * add docs * modify gpu doc * done --------- Co-authored-by: ivy-lv11 <lvzc@lamda.nju.edu.cn>		2024-02-29 16:33:42 +08:00
..
CPU	Add vLLM bf16 support (#10278)	2024-02-29 16:33:42 +08:00
GPU	Add vLLM bf16 support (#10278)	2024-02-29 16:33:42 +08:00