Balancing Generality and Specialization: A Survey on AI Datacenter Hardware Architecture

📅 2026-09-21
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
该论文通过分类和比较AI加速器架构,探讨了如何在通用性和专业化之间取得平衡以应对AI数据中心面临的挑战。
📝 Abstract
Rapidly growing AI workloads are driving large investments in AI datacenters. This survey classifies industrial AI accelerators into four architectural categories and compares their compute and memory organizations. It examines how node-, rack-, and pod-scale interconnects support collective communication, and traces architectural evolution across accelerator generations. The analysis connects advances in arithmetic throughput with changes in precision, data delivery, execution coordination, communication, power delivery, and cooling. It also discusses future design challenges arising from workload diversity, data movement, infrastructure constraints, and model evolution, showing how the trade-off between generality and specialization extends from individual accelerators to datacenter-scale systems. GitHub: github.com/Yufeng98/AI-datacenter
Problem

Research questions and friction points this paper is trying to address.

AI Datacenter
Hardware Architecture
Generality and Specialization
Workload Diversity
Data Movement
Innovation

Methods, ideas, or system contributions that make the work stand out.

AI Accelerators
Datacenter Hardware Architecture
Interconnects
Architectural Evolution
Workload Diversity
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
Y
Yufeng Gu
University of Michigan, USA
J
Jiazhen Wang
University of Michigan, USA
Reetuparna Das
Reetuparna Das
University of Michigan
Computer Architecture