The Cooperative Network Architecture: Learning Structured Networks as Representation of Sensory Patterns

2024-07-08

AI Summary

Current visual systems exhibit insufficient robustness to noise, deformation, and out-of-distribution (OOD) data, and lack unsupervised, compositional, and interpretable neural representation mechanisms. To address these limitations, we propose the Collaborative Network Architecture (CNA), which introduces a novel “network fragment” dynamic composition mechanism. CNA unsupervisedly discovers local structural primitives via statistical learning and recursively assembles them through structured sparse connectivity, yielding global–local coupled representations that adaptively encode sensory patterns. Without any labeled data, CNA achieves robust recognition under noise and geometric deformation, zero-shot schema completion, and generalization to unseen patterns—significantly enhancing OOD generalization. Its modular, interpretable neural representations establish a new paradigm for invariant object recognition, bridging compositional structure with biological plausibility and computational efficiency.

Technology Category

• Computer Vision: Representation Learning for Vision
• Machine Learning: Representation Learning
• Intelligent Robots: Multimodal Perception & Sensor Fusion

Application Category

• Graph Algorithms and Modeling for the Web: Representation, reconstruction, and subgraph or motif discovery in Web-related graphs
• Search and Retrieval-Augmented AI: Web query analysis, representation and understanding
• Responsible Web: Algorithmic accountability and transparency on the web

Abstract

We introduce the Cooperative Network Architecture (CNA), a model that represents sensory signals using structured, recurrently connected networks of neurons, termed"nets."Nets are dynamically assembled from overlapping net fragments, which are learned based on statistical regularities in sensory input. This architecture offers robustness to noise, deformation, and out-of-distribution data, addressing challenges in current vision systems from a novel perspective. We demonstrate that net fragments can be learned without supervision and flexibly recombined to encode novel patterns, enabling figure completion and resilience to noise. Our findings establish CNA as a promising paradigm for developing neural representations that integrate local feature processing with global structure formation, providing a foundation for future research on invariant object recognition.

Problem

• Represents sensory signals using structured recurrent neural networks
• Learns net fragments from sensory input statistical regularities
• Enables robust noise-resistant and out-of-distribution pattern recognition

Innovation

• Recurrently connected neuron networks represent sensory signals
• Dynamic assembly from learned overlapping net fragments
• Unsupervised learning enables noise resilience and pattern completion