🤖 AI Summary
Neural network representations suffer from opacity, knowledge overwrite, and structural uninterpretability—hindering continual learning in visual domains.
Method: This paper introduces the first structured continual learning framework tailored for visual space. It integrates environmental dynamics modeling, network refinement, and rerelation mechanisms to explicitly and hierarchically model object core structures and critical sub-variants in an incremental manner, thereby avoiding information diffusion and catastrophic forgetting inherent in conventional iterative optimization.
Contribution/Results: We achieve the first instance of structured continual learning for visual representations, yielding compact, interpretable, and generalizable hierarchical representations. Experiments on MNIST demonstrate zero-forgetting 2D shape detection, significant reduction in representation size, consistently improved accuracy, and emergent cross-task generalization—marking a paradigm shift beyond black-box neural representations.
📝 Abstract
Current machine learning paradigm relies on continuous representations like neural networks, which iteratively adjust parameters to approximate outcomes rather than directly learning the structure of problem. This spreads information across the network, causing issues like information loss and incomprehensibility Building on prior work in environment dynamics modeling, we propose a method that learns visual space in a structured, continual manner. Our approach refines networks to capture the core structure of objects while representing significant subvariants in structure efficiently. We demonstrate this with 2D shape detection, showing incremental learning on MNIST without overwriting knowledge and creating compact, comprehensible representations. These results offer a promising step toward a transparent, continually learning alternative to traditional neural networks for visual processing.