intel/ipex-llm - Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
* add more ops * checkin reduce * add All * support all and any * add operation Round * support floordiv and truncatediv * support FloorMode/Mod/TruncateMod * add exp/expm1 * add InTopK * add rint * remove a JDK8 api * fix style issue * fix a bug in floordiv |
||
|---|---|---|