Evaluating LLM outputs without fooling yourself
Vibes are not a metric. A practical framework for measuring whether your LLM feature is good — grounded in test sets, rubrics, and the honest limits of LLM-as-judge.
EvalsThe desk
Blog
Writing on software, AI agents, finance tooling, and the tools I build.
-
Evals Evals -
Systems Systems MCP: giving language models real tools
The Model Context Protocol turns an LLM from a text generator into something that can read your files, call your APIs, and act. Here is what it is and how to build a server that does not misbehave.
Systems -
Evals Retrieval RAG pipelines that actually work in production
Most RAG demos fall apart on real corpora. Here is the retrieval stack that survives messy documents, ambiguous queries, and users who paste in nonsense.
Retrieval