Scholar
Daniel Soudry
Google Scholar ID: AEBWEm8AAAAJ
Associate Professor
Neural Networks
Machine Learning
Theoretical neuroscience
Follow
Homepage
↗
Google Scholar
↗
Citations & Impact
All-time
Citations
16,437
H-index
38
i10-index
62
Publications
20
Co-authors
117
list available
Publications
20 items
UNREAL: Unifying Retrieval and Long-Context with a Single Model
2026
Cited
0
More Value per Key: Asymmetric Sparse Attention for Faster LLM Decoding
2026
Cited
0
Convergence of Continual Learning in Homogeneous Deep Networks
2026
Cited
0
Workspace Optimization: How to Train Your Agent
2026
Cited
0
Normalized Architectures are Natively 4-Bit
2026
Cited
0
Retrieval from Within: An Intrinsic Capability of Attention-Based Models
2026
Cited
0
Optimal L2 Regularization in High-dimensional Continual Linear Regression
2026
Cited
0
Block Sparse Flash Attention
2025
Cited
0
Load more
Resume
Academic Achievements
Multiple papers accepted to top-tier conferences including NeurIPS, ICML, and ICLR
Six papers accepted to NeurIPS 2025, two as Spotlights
Paper 'When Diffusion Models Memorize: Inductive Biases in Probability Flow of Minimum-Norm Shallow Neural Nets' accepted at ICML 2025
Paper 'Scaling FP8 training to trillion-token LLMs' accepted at ICLR 2025 as a Spotlight
Four papers accepted to NeurIPS 2024, including one Spotlight
ICML 2024 Spotlight paper and two ICLR 2024 acceptances
NeurIPS 2023 acceptance for 'How do Minimum-Norm Shallow Denoisers Look in Function Space?'
Named to The Marker’s '40 under 40' list
Collaboration with Intel featured in a public relations video
Co-authors
13 total
Elad Hoffer
PhD, Research
Nathan Srebro
Professor, TTIC and University of Chicago
Ron Banner
Machine Learning Researcher @ Intel & Technion
Ran El-Yaniv
Professor of Computer Science, Technion - Israel Institute of Technology. Chief Scientist - Deci AI
Yoshua Bengio
Professor of computer science, University of Montreal, Mila, IVADO, CIFAR
Suriya Gunasekar
MSR Redmond
Ron Meir
Professor of Electrical Engineeringe, Technion
Jason D. Lee
Associate Professor of EECS & Statistics at UC Berkeley