add zigman skill + local-model eval loop
- skills/zigman/SKILL.md: cross-client (agentskills.io) skill — read the langref
with zigman instead of guessing zig semantics
- evals/eval.py: ablation harness in does-it-tool's style (pydantic-ai over any
OpenAI-compatible endpoint). validator is the zig compiler, not an LLM judge.
selftest validates every oracle against a reference solution before spending
tokens; run does the bare-vs-zigman ablation and dumps JSON evidence
- evals/AXES.md: the dimensions the quality loop scores (api sensibility,
discoverability, output quality, ergonomics, portability, perf, robustness,
maintainability, aesthetics, distribution)
first baseline (gemma3-tools, ollama): bare 3/5, zigman 2/5 — and the model
never actually called zigman. signal: tasks need a real knowledge gap, and the
model must be induced to use the tool.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
zzstoatzz.io