Pinterest's FORTE framework safely finds and removes unneeded features in production recommenders

_reachsumit · x · 2026-10-12

Pinterest presents FORTE, a model-agnostic production framework for discovering, validating and removing features in industrial recommender systems. The core challenge is feature-lifecycle asymmetry: adding a feature must produce gains, while removal must not regress any metric — complicated by feature interactions, daily importance shifts, A/B test contention and multi-model consumption.

Key techniques: an efficient perturbation implementation enabling daily feature evaluation; grouped ablation over candidate sets built from all low-rank features to handle interactions; offline results predictive enough of online A/B tests to confidently advance deprecations; and lineage tracing that identifies all downstream consumer models to realize full training-set savings.

Validated over two large-scale recommender systems.

Original post →

More from Research

Research channel →