Differences

This shows you the differences between two versions of the page.

--- tips:rocm [2025/12/29 07:36] – [3\. ROCm (Optional but Recommended)] sscipioni
+++ tips:rocm [2025/12/29 23:04] (current) – [3\. ROCm (Optional but Recommended)] sscipioni
@@ Line 43: / Line 43: @@
 ```bash
 # Install essential ROCm packages
-yay -S rocm-core amdgpu_top rocminfo
+yay -S rocm-core amdgpu_top rocminfo rocm-gfx1151-bin
 yay -S rocm-hip-sdk rocm-opencl-runtime
 sudo usermod -a -G render,video $USER
@@ Line 139: / Line 139: @@
+====== lemonade-server ======
+<code | download>
+yay -S lemonade-server
+</code>
+oga-hybrid mode: this splits the work, the NPU handles the prefill (prompt processing), and the iGPU handles the generation.
+<code | download>
+lemonade-server run Qwen3-Coder-30B-A3B-Instruct-GGUF --recipe oga-hybrid --llamacpp rocm
+</code>
+<code | download>
+curl http://localhost:8000/api/v1/chat/completions \
+                    -H "Content-Type: application/json" \
+                    -d '{
+                  "model": "Qwen3-Coder-30B-A3B-Instruct-GGUF",
+                  "messages": [{"role": "user", "content": "Who are you?"}],
+                  "stream": false
+                }'
+curl http://localhost:8000/api/v1/stats
+</code>
 ====== Benchmark ======

Galileo Labs