Equivariant neural networks and equivarification

📅 2019-06-17
🏛️ arXiv.org
📈 Citations: 15
✨ Influential: 0
📄 PDF
🤖 AI Summary
This work addresses the lack of explicit symmetry modeling in standard neural networks. We propose “equivarification,” a general equivariance-enabling framework that transforms arbitrary off-the-shelf architectures into models equivariant to user-specified groups (e.g., SE(2))—without architectural modification. Guided by group representation theory, the method applies tensor rearrangement, feature-space projection, and symmetry-constrained convolutional kernels. Crucially, it achieves plug-and-play equivariance for generic network designs. Evaluated on CNN-based image classification, equivarified models demonstrate significantly improved robustness to rotations and translations, validating both efficacy and generalizability. Our core contribution lies in bridging generic neural architectures with symmetry priors: we rigorously embed group-equivariant inductive biases while fully preserving architectural flexibility and expressivity.
📝 Abstract
We provide a process to modify a neural network to an equivariant one, which we call equivarification. As an illustration, we build an equivariant neural network for image classification by equivarifying a convolutional neural network.
Problem

Research questions and friction points this paper is trying to address.

Enforcing equivariance in neural networks through a general modification method
Preserving data symmetries via a process called equivarification
Demonstrating group convolutional neural networks as a framework special case
Innovation

Methods, ideas, or system contributions that make the work stand out.

Modifies neural networks to enforce equivariance
Introduces equivarification as a general method
Shows G-CNNs as special case of framework
🔎 Similar Papers