intel/ipex-llm - Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
5c66b437be
* serveral fix for preprocessing * load all * fix tests * more fixes * meet code review * fix style * fix style * fix tests * fix tests * rebase and fix api * refine test case * fix tests * add transpose * fix tests * fix expandims * fix serializer * fix doc |
||
|---|---|---|