Independent tests of open local models on home-level hardware. Not a taOS feature demo.

Results / LFM2.5 24B A2B Q4_K_M (llama.cpp)

LFM2.5 24B A2B Q4_K_M (llama.cpp)

opencrabsllamacppomarchy (RTX 3090 24 GB)scene

This run produced no playable build.

Metrics

Checklist score
– / 100
Design (rubric, 0–5)
–
Stop reason
done
Model time
5mins
Tool time (wall minus model)
4s
Wall time
5mins
Tool calls
–
Tool errors
–
Errors by type
–
Loop-guard events
–
Tokens in / out
1,519,189.0 / 43,753.0
Thinking tokens
–
Decode / prefill tok/s
164.6 / 4,397.3
Prefix reuse
0.973
Peak VRAM (GPU / engine)
15,081 / 15,072 MiB
Peak engine RAM
2,292 MiB
Engine
llamacpp
Model
LFM2.5 24B A2B Q4_K_M (llama.cpp) (lfm25-24b-a2b)
Settings
{"thinking": "medium", "reasoning_budget_tokens": 3072, "max_tokens": 7168, "sampling": "card: temp 0.1 top_k 50 repeat_penalty 1.05 (server)", "note": "harness model id is a Strata alias name; llama-server serves its one model whatever the request names"}
Node
omarchy (RTX 3090 24 GB)
Prompt
scene-pagoda-v1
Started
2026-10-30T01:21:19Z

Feature scores

Screenshots

Landing page at desktop and phone widths, and the game at noon, at night, after breaking a block, and on a phone.

Checklist (0 pass, 0 partial, 0 fail)

FeatureTestScoreEvidence

Suite · · WebGL:

Steers

None: an unsteered run gets the prompt and nothing else.