About the job
Join our EC2 Nitro Machine Learning Systems team to lead a pivotal performance engineering group at the intersection of state of the art ML research and production-scale infrastructure. You'll build and manage a team focused on establishing EC2 as the definitive source for ML performance optimization across diverse workloads including LLMs, multimodal models, and next-generation AI applications. Your work will directly influence product management, marketing, and executive decision-making by delivering comprehensive performance data and best practices for AWS's accelerated computing platforms.
Responsibilities
Lead the design, implementation, and delivery of foundational ML performance measurement infrastructure that operates as reliable CI/CD systems across diverse accelerator platforms
Build and nurture a high-performing engineering team focused on establishing EC2's source for ML performance best-known-configurations
Drive architectural decisions that influence future platform design by feeding insights from state-of-the-art research and customer workloads into accelerated platform launches
Develop comprehensive regression coverage across all major component releases including frameworks, firmware, drivers, and networking components
Establish mechanisms to scale performance engineering practices from current LLM focus to multimodal models, Mixture-of-Experts architectures, and emerging AI application domains
Qualifications
Minimum
3+ years of engineering team management experience
7+ years of working directly within engineering teams experience
3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
Experience partnering with product or program management teams
Preferred
Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers