Galileo Labs

User Tools

Site Tools

You are here: start » tips » llm
tips:llm

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
tips:llm [2026/02/14 10:30] – sscipionitips:llm [2026/02/15 08:29] (current) – sscipioni
Line 31: Line 31:
 ^ model                  ^ capabilities             ^ size     ^ context  ^ quantization                                                                      ^ eval rate [token/s]  ^ prompt eval rate [token/s]  ^ ^ model                  ^ capabilities             ^ size     ^ context  ^ quantization                                                                      ^ eval rate [token/s]  ^ prompt eval rate [token/s]  ^
 | llama3.2  | completion tools | "3.2B"   | 131072    | "Q4_K_M" | 52.78 | 1957.30 | | llama3.2  | completion tools | "3.2B"   | 131072    | "Q4_K_M" | 52.78 | 1957.30 |
 +| qwen-strixhalo  | completion tools | "30.5B"   | 262144    | "Q4_K_M" | 53.54 | 1056.37 |
 | qwen3-coder  | completion tools | "30.5B"   | 262144    | "Q4_K_M" | 52.10 | 776.55 | | qwen3-coder  | completion tools | "30.5B"   | 262144    | "Q4_K_M" | 52.10 | 776.55 |
 | qwen3:30b-a3b  | completion tools thinking | "30.5B"   | 262144    | "Q4_K_M" | 50.19 | 803.06 | | qwen3:30b-a3b  | completion tools thinking | "30.5B"   | 262144    | "Q4_K_M" | 50.19 | 803.06 |
Line 47: Line 48:
  
  
 +ollama model
 +<code>
 +FROM qwen3-coder
  
 +# STRIX HALO AGENTIC TUNING
 +PARAMETER num_ctx 128000
 +PARAMETER num_batch 1024
 +PARAMETER num_predict 4096
 +
 +SYSTEM """
 +You are a Strix Halo Optimized Coding Agent. 
 +Always use asynchronous patterns and favor memory-efficient algorithms.
 +"""
 +</code>
  
tips/llm.1771061435.txt.gz · Last modified: by sscipioni

Page Tools

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki