Three ways to execute a AND b AND c: DataFusion filter PR explained

Abhishekcur · x · 2026-10-19

A subtle database engineering detail: even a simple a AND b AND c filter has multiple execution strategies over a columnar batch — gather-every-step, evaluate-everything-then-AND, or a running mask (the shape of DataFusion PR #25771). The running mask usually wins; the full-evaluation path pays 12 ms for running the expensive predicate on every row. Includes a visualization of all three paths.

Original post →

More from Research

Research channel →