2 commits

Author	SHA1	Message	Date
Wang, Jian4	23681fbf5c	Support codegeex4-9b for lightweight-serving (#11648) ... * add options, support prompt and not return end_token * enable openai parameter * set do_sample None and update style	2024-07-26 09:41:03 +08:00
Wang, Jian4	1eed0635f2	Add lightweight serving and support tgi parameter (#11600) ... * init tgi request * update openai api * update for pp * update and add readme * add to docker * add start bash * update * update * update	2024-07-19 13:15:56 +08:00