intel/ipex-llm - Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
36685c3226
* add dynamic caffe loading support * refined with bug fix and more commnets * fix typo and bias check for convolution * renaming change * fix import reference * refine customized layer support * fix style check issue * resolve style issue * resolve conflict * caffe persister implementation * refinement with pr * rename loadcaffe name * fix typo * add docs |
||
|---|---|---|