intel/ipex-llm - Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
* Support control flow * Decouple input/output tensor numeric type from the module numeric type(parameter type). * FIx unit tests * while loop api refactor * fix unit test * make breeze version configurable as spark 2.1 bump breeze version * Add scheduler to exclude layers * remove control-flow change * remove Schduler and ControlOps * fix broken unit test |
||
|---|---|---|