🤖 AI Summary
This work addresses the challenges of content cold-start and exposure bias in industrial-scale search and recommendation systems by proposing the first unified exploration and debiasing architecture that spans the entire funnel across multiple stages, applicable to both search and recommendation scenarios. The approach integrates multi-stage modeling, content debiasing algorithms, a controllable online exploration mechanism, and a scalable causal evaluation framework, enabling efficient exploration of new content while maintaining control over short-term performance metrics. Deployed at Pinterest for two years, the system has significantly improved the exposure efficiency of new content, enhanced user engagement, and fostered overall ecosystem health, while supporting rapid experimental iteration and long-term optimization.
📝 Abstract
In this paper, we propose a new solution for addressing the content cold-start problem in industry-scale search and recommender systems. Compared to prior approaches, we have made the following new contributions: 1) our solution spans the entire multi-stage funnel and generalizes well for both search and recommendation surfaces, 2) our solution reduces bias favoring existing content, allowing more accurate model prediction across content types and reducing short-term tradeoffs associated with high volumes of explicit content exploration, 3) our solution is evaluated with a scalable measurement framework that enables fast short-term experimentation while validating long-term impact. We have iteratively built and successfully deployed this new system at Pinterest in the past two years and observed significant improvements in fresh content exploration, overall user engagement, and content ecosystem health.