Column docs and lineage are a hole: dbt is the closest native fix, hyperscalers lag

teodorio · x · 2026-11-22

A discussion on the metadata gap in data engineering. teodorio points out that column descriptions, field purposes, and lineage docs are rarely maintained; kirstenlum notes you'd have to actually read the YAML/SQL files — which nobody wants to do anymore. dbt can handle this fairly natively via yml/json or plain SQL with a decent medallion structure, but the hyperscalers still have a big hole here.

Original post →

More from coding & agent

coding & agent channel →