The Technicians MBA Subscribe

AI

Evals

Tests of how well an AI system performs on a set of example tasks, used to compare models and catch problems before release.

You'll hear it as

The new model scored better on our evals, so we switched.

Why it matters to you.

Without evals, you're judging an AI feature by vibes. Build a set of real examples early.

Related terms.

Videos.

No video mentions Evals by name yet. These are on the same topic, AI & the tech industry.

The newsletter

The business side of technical work, in your inbox.

Free, through Substack. Unsubscribe whenever you like.