Ragas
An evaluation framework for retrieval-augmented generation systems — faithfulness, answer relevance, context precision, and more.
MLOps Intermediate
Category
MLOps
Difficulty
Intermediate
When to use
You have a RAG pipeline and need quantitative metrics beyond eyeballing outputs, especially for regression testing and comparison.
When not to use
You have no eval set at all yet — build one first, then reach for Ragas.
Alternatives
TruLens DeepEval LangSmith evals Custom LLM-as-judge