tips:rocm
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| tips:rocm [2026/02/03 18:29] – [Comfy] sscipioni | tips:rocm [2026/02/15 08:33] (current) – [1\. Kernel and Firmware] sscipioni | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| References: | References: | ||
| - https:// | - https:// | ||
| + | - https:// | ||
| + | - https:// | ||
| This report outlines the deployment of the **Ollama LLM runtime** on **Arch Linux** specifically tailored for the **AMD Ryzen AI Max+ 395 APU**. The primary focus is optimizing performance by leveraging the integrated **Radeon 8060S iGPU** through the **Vulkan** backend, and considering the potential of the **XDNA 2 NPU** for heterogeneous acceleration. | This report outlines the deployment of the **Ollama LLM runtime** on **Arch Linux** specifically tailored for the **AMD Ryzen AI Max+ 395 APU**. The primary focus is optimizing performance by leveraging the integrated **Radeon 8060S iGPU** through the **Vulkan** backend, and considering the potential of the **XDNA 2 NPU** for heterogeneous acceleration. | ||
| Line 19: | Line 20: | ||
| Before deploying Ollama, the base Arch Linux installation must have the correct drivers and utilities to fully expose the APU's capabilities, | Before deploying Ollama, the base Arch Linux installation must have the correct drivers and utilities to fully expose the APU's capabilities, | ||
| ### 1\. Kernel and Firmware | ### 1\. Kernel and Firmware | ||
| + | |||
| + | Set in bios UMA buffer size to 8G or lower. | ||
| + | |||
| Ensure the system is running a recent kernel (e.g., $6.10+$ or later) for optimal Zen 5 and RDNA 3.5 support. | Ensure the system is running a recent kernel (e.g., $6.10+$ or later) for optimal Zen 5 and RDNA 3.5 support. | ||
| Line 29: | Line 33: | ||
| sudo systemctl mask sleep.target suspend.target hibernate.target hybrid-sleep.target | sudo systemctl mask sleep.target suspend.target hibernate.target hybrid-sleep.target | ||
| ``` | ``` | ||
| + | |||
| + | add to kernel parameters | ||
| + | ``` | ||
| + | iommu=pt amdgpu.gttsize=126976 ttm.pages_limit=32505856 | ||
| + | ``` | ||
| + | |||
| ### 2\. Graphics and Compute Drivers (Vulkan) | ### 2\. Graphics and Compute Drivers (Vulkan) | ||
| Line 37: | Line 47: | ||
| sudo pacman -S mesa vulkan-radeon lib32-vulkan-radeon vulkan-headers | sudo pacman -S mesa vulkan-radeon lib32-vulkan-radeon vulkan-headers | ||
| ``` | ``` | ||
| + | ` | ||
| ### 3\. ROCm (Optional but Recommended) | ### 3\. ROCm (Optional but Recommended) | ||
tips/rocm.1770139743.txt.gz · Last modified: by sscipioni
