2 commits

Author	SHA1	Message	Date
Guancheng Fu	2d930bdca8	Add vLLM bf16 support (#10278) ... * add argument load_in_low_bit * add docs * modify gpu doc * done --------- Co-authored-by: ivy-lv11 <lvzc@lamda.nju.edu.cn>	2024-02-29 16:33:42 +08:00
Guancheng Fu	963a5c8d79	Add vLLM-XPU version's README/examples (#9536) ... * test * test * fix last kv cache * add xpu readme * remove numactl for xpu example * fix link error * update max_num_batched_tokens logic * add explaination * add xpu environement version requirement * refine gpu memory * fix * fix style	2023-11-28 09:44:03 +08:00