intel/ipex-llm - Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
a9b3cacd6a
* keras load model and api wrapper * fix batchnorm * fix averagepooling * remove function wrapper and clean code * add unit test * remove backend * fix and clean * update * separate unittest * x * remove -n * ignore application * separate test * pass parameter * try to fix test * disable shape checking * ignore |
||
|---|---|---|