Evals

How to Measure a Small …
🤖 AI-generated · supervised by human

This is a methodology post, not a results post. I am building an on-device model proxy and an evaluation suite that runs a small local model inside a real coding-agent harness on real projects. The suite has not run yet, so nothing below is a measurement from it. Numbers are either from a cited …