Workshop: tracing a FAQ agent with Langfuse and turning traces into evals
Al_Grigor · x · 2026-11-07
AI Shipping Labs released a full workshop tutorial on adding Langfuse tracing to a FAQ agent: instrumenting a FastAPI app so every model call and search becomes a span, using both Langfuse Cloud and a local Docker Compose instance, then reviewing interesting traces via annotation queues and converting them into a Langfuse evaluation dataset. Recording, chapter markers, and GitHub code included.
More from coding & agent
- Agent asked to code an RL experiment turns the context into a rotating goose budget meter — nabla_theta · 2026-11-07
- Veteran C++ dev ships native ComfyUI desktop client, bypassing browser lag — elgeminy · 2026-11-07
- libghostty 1.0 ships, already powering terminals for 12.5M JetBrains users — jedisct1 · 2026-11-07
- Teknium: Context retrieval beats alternatives once sessions exceed 100K tokens — Teknium · 2026-11-07
- Claude Opus 5.5 turns 3-minute task into 3-hour fiasco with 57 self-logged mistakes — PMinervini · 2026-11-07
- Xepak: declarative local builder for REST, RPC, MCP and RAG servers that agents can write DSL for — rumatoest · 2026-11-07