LLM

model	capabilities	size	context	quantization	eval rate [token/s]	prompt eval rate [token/s]
llama3.2	completion tools	“3.2B”	131072	“Q4KM”	88.14	715.43
ministral-3:14b	completion vision tools	“13.9B”	262144	“Q4KM”	23.78	302.07
qwen3-coder:30b	completion tools	“30.5B”	262144	“Q4KM”	73.75	72.41
llama3:70b	completion	“70.6B”	8192	“Q4”	5.55	9.72
llava	completion vision	“7B”	32768	“Q4”	49.92	207.27
deepseek-coder-v2:16b	completion insert	“15.7B”	163840	“Q4”	84.44	111.71
bjoernb/qwen3-coder-30b-1m:latest	completion tools	“30.5B”	1048576	“Q4_K_M”	74.23	94.84

Galileo Labs