Crack your next interview in 2 weeks — cohort starts Jul 27 — Join free →
← AI Engineering Fundamentals

A test harness for LLM prompts: define test cases in YAML, score responses with an LLM judge across multiple dimensions, and get a nonzero exit code on failure so it runs in CI. Every project before this one, you tested by eyeballing the output. This is where you learn to test AI systems the way you’d test any other code — repeatably, and without a human in the loop every time.

Eval engineering is an explicitly named skill in senior AI Engineer job descriptions — this project lets you say you've built a CI-integrated eval harness, not just 'tested prompts manually.'