A Tilted Bowl Is Not a Slippery Slope: Compressing Looped Models
This study addresses the performance collapse in recurrent model compression caused by the accumulation of misjudged rounding errors. To this end, it proposes the "tilted bowl" theory, which reveals that fixed rounding errors within convergent loops merely shift the stopping point rather than accumulating progressively. Building upon this theoretical insight, the work integrates quantization-aware training with 8-bit mixed-precision inference to construct a dynamic depth controller based on unlabeled measurements, enabling effective error failure prediction and recovery. Evaluated on Sudoku and Maze tasks, the proposed method surpasses fixed-depth inference baselines by up to 15 points while requiring lower weight traffic, thereby significantly enhancing the inference efficiency of recurrent neural networks.