Tag: #ragas
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 6 posts
6 posts are tagged #ragas; the most recent was published on 2026-05-16.
Often tagged together: #evaluation 4 #2026-03 3 #deepeval 3 #chatbot 2 #llm 2
Most read in the last 90 days:
- LLM Observability & Prompt Tools 2026 — Helicone / LangSmith / Langfuse / Braintrust / Athina / Comet Opik / Portkey Deep Dive
- RAG Quality Evaluation and Failure Pattern Analysis: Diagnosing and Improving Retrieval-Augmented Generation
- RAG Chatbot Evaluation in Practice: From Offline/Online Quality Measurement to Production Guardrails
LLM Observability & Prompt Tools 2026 — Helicone / LangSmith / Langfuse / Braintrust / Athina / Comet Opik / Portkey Deep Dive ♪ Listenable
The 2026 LLM ops map. Helicone (YC) · LangSmith (LangChain) · Langfuse (open source, Series A) · W&B Weave · Arize Phoenix · Braintrust · Athina · Comet Opik (released March 2025) · Vellum · PromptHub · Portkey AI Gatewa
2026-05-16 · 22 min read #llm-observability#prompt-engineering#helicone#langsmith#langchainRAGAS Complete Guide: How to Quantitatively Evaluate Your RAG System
Learn to use RAGAS — the gold standard for RAG evaluation — to measure Faithfulness, Answer Relevancy, Context Precision, and Context Recall. Includes complete Python code, automated CI/CD evaluation pipelines, synthetic
2026-03-18 · 9 min read #ragas#rag-evaluation#llm-evaluation#ai-development#qualityComplete Guide to LLM Evaluation and Benchmarking: MMLU, MT-Bench, RAGAS, LM-Eval
A complete guide to evaluating LLMs correctly. Covers standard benchmarks such as MMLU, MT-Bench, and HumanEval, evaluating RAG systems with RAGAS, practical use of LM-Evaluation-Harness, and building production LLM eval
2026-03-17 · 17 min read #llm#evaluation#benchmark#ragas#lm-evalBuilding a Chatbot Evaluation Framework: LLM-as-Judge, RAGAS, and Automated Testing Pipelines ♪ Listenable
A comprehensive guide to building systematic quality evaluation for LLM-based chatbots. Covers RAG pipeline evaluation with RAGAS, LLM-as-Judge patterns, automated testing pipelines, and production monitoring.
2026-03-10 · 27 min read #chatbot#evaluation#ragas#llm-as-judge#testingRAG Quality Evaluation and Failure Pattern Analysis: Diagnosing and Improving Retrieval-Augmented Generation
A systematic guide to evaluating RAG (Retrieval-Augmented Generation) system quality and analyzing common failure patterns. Covers evaluation metrics for Retriever, Reranker, and Generator components, framework compariso
2026-03-07 · 15 min read #rag#llm#evaluation#ragas#deepevalRAG Chatbot Evaluation in Practice: From Offline/Online Quality Measurement to Production Guardrails
Covers the evaluation system for reliably operating RAG chatbots in production. Addresses offline benchmarks, LLM-as-a-Judge, online experiments, alert thresholds, and regression prevention pipelines with code.
2026-03-04 · 16 min read #chatbot#rag#evaluation#llmops#production