Similarity Pairing with Energy Mover's Distance for Self-Supervised Pre-Training at the LHC

📅 2026-09-15
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
本文提出了一种基于能量搬运距离(EMD)的数据驱动方法,用于大型强子对撞机(LHC)自监督预训练中的事件相似性配对,避免了手工设计的数据增强问题。
📝 Abstract
Many self-supervised methods for training foundation models at the Large Hadron Collider (LHC) rely on data augmentations to encourage the model to embed events into a representation space invariant to certain physical or detector symmetries. A common challenge arises from the large freedom in choosing a proper set of augmentations on which downstream performance depends. The implementation of augmentations involves either modifying existing events, potentially breaking the event fidelity, or simulating more event variants, which is computationally intensive. In this work, we present a data-driven method of pairing events by their similarity via the energy mover's distance (EMD), which measures how similar two events are in terms of the work required to transform one into the other. With this approach, distinct events are sampled and matched by their similarity to serve as views for learning invariance, keeping the physics content of each event intact without handcrafted distortions. We demonstrate this augmentation-free pairing method by pre-training on QCD jets via self-distillation and show that it can yield semantic jet embeddings with downstream discrimination power comparable to or better than an augmentation-based baseline.
Problem

Research questions and friction points this paper is trying to address.

self-supervised methods
data augmentations
event fidelity
energy mover's distance
LHC
Innovation

Methods, ideas, or system contributions that make the work stand out.

Energy Mover's Distance
Self-Supervised Pre-Training
Data-Driven Method
Event Pairing
🔎 Similar Papers
2024-07-29Physical Review DCitations: 0
💼 Related Jobs
No related jobs found.
H
Ho Fung Tsoi
Department of Physics and Astronomy, University of Pennsylvania, USA
D
Dylan Rankin
Department of Physics and Astronomy, University of Pennsylvania, USA