Scientific Discovery under Validation Congestion via Multi-Fidelity Pairwise Rankings
This study addresses the verification bottleneck in scientific discovery arising from the disparity between an overabundance of candidate designs and scarce experimental resources. To overcome this challenge, we propose PRISMS, a framework that replaces data-dependent regression models with multi-fidelity expert pairwise ranking, thereby eliminating reliance on absolute score prediction. Furthermore, it dynamically upgrades query fidelity using a Fisher information criterion and integrates active learning strategies to efficiently screen high-potential designs. In drug screening tasks, PRISMS significantly improves recall rates while reducing the number of required experimental rounds, achieving an approximate 18.8% improvement in task hypervolume over baseline methods.