Anshumali Shrivastava
Scholar

Anshumali Shrivastava

Google Scholar ID: SGT23RAAAAAJ
Rice University, ThirdAI Corp.
Machine LearningLarge Scale Deep LearningInformation Retrieval
Homepage↗Google Scholar↗
Citations & Impact
All-time
Citations
3,882
 
H-index
34
 
i10-index
73
 
Publications
20
 
Co-authors
0
 
Contact
CVOpen ↗TwitterOpen ↗GitHubOpen ↗
Publications
12 items
Forget Without Compromise: Nexus Sampling for Streaming KV-Cache Eviction Under Fixed Budgets
2026
Cited
0
Inference Time Context Sparsity: Illusion or Opportunity?
2026
Cited
0
Superintelligent Retrieval Agent: The Next Frontier of Information Retrieval
2026
Cited
0
Scout Before You Attend: Sketch-and-Walk Sparse Attention for Efficient LLM Inference
2026
Cited
0
SOCKET: SOft Collison Kernel EsTimator for Sparse Attention
2026
Cited
0
Replacing Softmax Similarity with a Sharpened Angular Similarity: Theory and Practice of Scaling To Billion-Context Attention
2025
Cited
0
To Compress or Not? Pushing the Frontier of Lossless GenAI Model Weights Compression with Exponent Concentration
2025
Cited
0
REFRAG: Rethinking RAG based Decoding
2025
Cited
0
Resume
Academic Achievements
  • Selected Preprints:
  • - Replacing Softmax Similarity with a Sharpened Angular Similarity: Theory and Practice of Scaling To Billion-Context Attention
  • - To Compress or Not? Pushing the Frontier of Lossless GenAI Model Weights Compression with Exponent Concentration
  • - REFRAG: Rethinking RAG based Decoding
  • Commercial Deployments:
  • - Amazon Product Search: Deployment of our hashing algorithm based on FLASH Engine (SIGMOD 2018) in the Amazon Search Engine
  • - BOLT Engine: At ThirdAI Corp., developing sparsity and hash tables to democratize AI on CPUs
  • Awards/Honors:
  • - Charles W. Duncan Jr. Achievement Award for Outstanding Faculty 2023
  • - IIT Kharagpur, Young Alumni Achiever Award (YAAA), 2023
  • - Outstanding Paper Award, MLSys 2022
  • - Awarded Tenure at Rice (Early)
  • - George R. Brown School of Engineering, Rice University, 2021 Young Faculty Research Award
  • - Adobe Data Science Research Awards 2021
  • - National Academy of Engineers (NAE) 2019 US Frontiers of Engineering Alum
  • - ACM SIGMOD 2018 Most Reproducible Paper Award
  • - Science News 10 Scientist to Watch, 2018
  • - Best Student Paper Competition Award at IISA, 2018
  • - Amazon Research Awards, 2017
  • - AFOSR Young Investigator Award (YIP), 2017
  • - NSF CAREER AWARD, 2017
  • - NIPS Best Paper, 2014
  • - IEEE/ACM ASONAM Best Paper, 2014
  • - Institute Silver Medal, IIT Kharagpur, 2008
Research Experience
  • Previously held positions at Amazon, AWS, Blackstone, and FICO
  • Founder of ThirdAI Corp. (Acquired in August 2025) and xmad.ai (Sept 2024) --> Workato (July 2025)
Education
  • Information not provided
Background
  • Currently at Meta Superintelligence Labs (on Leave from Rice)
  • Professor, Computer Science and Ken Kennedy Institute, Rice University
  • Research Interests: Large Scale Machine Learning, Scalable and Sustainable Deep Learning, Randomized Algorithms for AI/LLMs, Information Retrieval
Miscellany
  • Personal Interests: Writing about AI, Businesses, LLMs
  • Blogging Platforms: Medium