ipex-llm/docs/mddocs/Quickstart/ollama_portablze_zip_quickstart.md

Run Ollama Portable Zip on Intel GPU with IPEX-LLM

This guide demonstrates how to use Ollama portable zip to directly run Ollama on Intel GPU with ipex-llm (without the need of manual installations).

Note

Currently, IPEX-LLM only provides Ollama portable zip on Windows.

Table of Contents

• Prerequisites
• Step 1: Download and Unzip
• Step 2: Start Ollama Serve
• Step 3: Run Ollama

Prerequisites

Check your GPU driver version, and update it if needed:

• For Intel Core Ultra processors (Series 2) or Intel Arc B-Series GPU, we recommend updating your GPU driver to the latest

• For other Intel iGPU/dGPU, we recommend using GPU driver version 32.0.101.6078

Step 1: Download and Unzip

Download IPEX-LLM Ollama portable zip from the link.

Then, extract the zip file to a folder.

Step 2: Start Ollama Serve

Double-click start-ollama.bat in the extracted folder to start the Ollama service. A window will then pop up as shown below:

Step 3: Run Ollama

You could then use Ollama to run LLMs on Intel GPUs as follows:

• Open "Command Prompt" (cmd), and enter the extracted folder through cd /d PATH\TO\EXTRACTED\FOLDER
• Run ollama run deepseek-r1:7b in the "Command Prompt" (you may use any other model)