Tag: #llm-eval
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 2 posts
Agent Evaluation Systems in 2026 — Inspect AI vs Promptfoo vs Phoenix vs LangSmith vs OpenAI Evals (You're Measuring the Agent, Not the Model) ♪ Listenable
LLM evals measure the model. Agent evals measure whether the model plus the harness plus the tools actually carry a task to completion. They are different problems. This is a map of the 2026 landscape — Inspect AI from U
2026-05-14 · 20 min read #agent-evaluation#inspect-ai#promptfoo#phoenix#langsmithLLM Evaluation & Observability: Eval Harness, LLM-as-Judge, Tracing, Regression Prevention (2025)
Claiming a new model "seems better" is not science. The 1 failure mode of 2025 LLM products is "not measuring". Eval harness design, LLM-as-judge pitfalls and calibration, 3-layer observability (Trace/Span/Metric), produ
2026-04-15 · 11 min read #llm-eval#observability#llm-judge#distributed-tracing#langsmith