ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update llamacpp_portable_zip_gpu_quickstart (#12941)

Browse source
This commit is contained in:
Jason Dai 2025-03-06 10:01:56 +08:00 committed by GitHub
parent 32480cc8ed
commit 1432c5d9a0
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 4 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
docs/mddocs/Quickstart/llamacpp_portable_zip_gpu_quickstart.md
View file

@ -4,7 +4,7 @@
</p>
>[!Important]
> We can now run **DeepSeek-R1-671B-Q4_K_M** with 1 or 2 Arc A770 on Xeon using the latest [llama.cpp Portable Zip](#flashmoe-for-deepseek-v3r1).
> You can now run **DeepSeek-R1-671B-Q4_K_M** with 1 or 2 Arc A770 on Xeon using the latest [llama.cpp Portable Zip](#flashmoe-for-deepseek-v3r1).
This guide demonstrates how to use [llama.cpp portable zip](https://github.com/intel/ipex-llm/releases/tag/v2.2.0-nightly) to directly run llama.cpp on Intel GPU with `ipex-llm` (without the need of manual installations).
@ -26,7 +26,7 @@ This guide demonstrates how to use [llama.cpp portable zip](https://github.com/i
- [Step 1: Download and Extract](#step-1-download-and-extract)
- [Step 2: Runtime Configuration](#step-2-runtime-configuration-1)
- [Step 3: Run GGUF models](#step-3-run-gguf-models-1)
- [(New) FlashMoE for DeepSeek V3/R1 using llama.cpp](#flashmoe-for-deepseek-v3r1)
- [(New) FlashMoE for DeepSeek V3/R1 671B using llama.cpp](#flashmoe-for-deepseek-v3r1)
- [Tips & Troubleshooting](#tips--troubleshooting)
- [Error: Detected different sycl devices](#error-detected-different-sycl-devices)
- [Multi-GPUs usage](#multi-gpus-usage)

4
docs/mddocs/Quickstart/llamacpp_portable_zip_gpu_quickstart.zh-CN.md
View file

@ -6,7 +6,7 @@
本指南演示如何使用 [llama.cpp portable zip](https://github.com/intel/ipex-llm/releases/tag/v2.2.0-nightly) 通过 `ipex-llm` 在 Intel GPU 上直接免安装运行。
> [!Important]
> 使用最新 [llama.cpp Portable Zip](#flashmoe-运行-deepseek-v3r1), 可以在 Xeon 上通过1到2张 Arc A770 GPU 运行 **DeepSeek-R1-671B-Q4_K_M**
> 使用最新版 [llama.cpp Portable Zip](#flashmoe-运行-deepseek-v3r1), 可以在 Xeon 上通过1到2张 Arc A770 GPU 运行 **DeepSeek-R1-671B-Q4_K_M**
> [!NOTE]
> llama.cpp portable zip 在如下设备上进行了验证：
@ -26,7 +26,7 @@
- [步骤 1：下载与解压](#步骤-1下载与解压-1)
- [步骤 2：运行时配置](#步骤-2运行时配置-1)
- [步骤 3：运行 GGUF 模型](#步骤-3运行-gguf-模型-1)
- [(新功能) FlashMoE 运行 DeepSeek V3/R1](#flashmoe-运行-deepseek-v3r1)
- [(新功能) FlashMoE 运行 DeepSeek V3/R1 671B](#flashmoe-运行-deepseek-v3r1)
- [提示与故障排除](#提示与故障排除)
- [错误：检测到不同的 sycl 设备](#错误检测到不同的-sycl-设备)
- [多 GPU 配置](#多-gpu-配置)