ipex-llm/python/llm/src/ipex_llm/serving/fastapi
Wang, Jian4 b3b2cd64b4
Support lightweight-serving glm-4v-9b (#11994)
* enable glm-4v-9b serving

* update readme

* update for no image input
2024-09-05 09:25:08 +08:00
..
__init__.py Refactor fastapi-serving and add one card serving(#11581) 2024-07-17 11:12:43 +08:00
api_server.py Support lightweight-serving glm-4v-9b (#11994) 2024-09-05 09:25:08 +08:00
model_worker.py Support lightweight-serving glm-4v-9b (#11994) 2024-09-05 09:25:08 +08:00
openai_protocol.py Add lightweight-serving whisper asr example (#11847) 2024-08-22 15:46:28 +08:00
tgi_protocol.py Remove tgi parameter validation (#11688) 2024-07-30 16:37:44 +08:00