Ragas: Open-source framework for LLM evaluation and test set generation
goyalshaliniuk · x · 2026-09-01
Ragas is an open-source toolkit designed for evaluating and optimizing Large Language Model applications. It replaces time-consuming subjective assessments with objective metrics and data-driven workflows. Key features include:
- Objective Metrics: Quantifies RAG system performance using metrics like Faithfulness and Answer Relevancy.
- Test Set Generation: Automatically generates production-aligned test sets to solve data scarcity.
- Integration: Compatible with LangChain, LlamaIndex, and other mainstream frameworks.
The project has garnered 15.6k stars on GitHub.
More from coding & agent
- Open-source virtual computer MCP gives LLMs a full desktop in your browser — Ambitious-Prompt-975 · 2026-09-01
- Dev builds FinBridge MCP: 33 tools for Korean + US market data in agent workflows — JakeChj · 2026-09-01
- Dev Reports Sol Built a Useful Model Probe Tool and Handled Refactors Well — voooooogel · 2026-09-01
- Indie founder rebuilds startup site in 3 days with AI: Sol does grunt work, human directs — kylegawley · 2026-09-01
- mitsuhiko: server-side context compaction breaks session portability for no technical reason — mitsuhiko · 2026-09-01
- ElevenLabs launches MCP integration for Claude — petewoodbridge · 2026-09-01