About the job
Build the multi-agent orchestration platform that autonomously executes ML research workflows — from hypothesis generation through production deployment — accelerating how we deliver relevant sponsored products to hundreds of millions of Amazon shoppers. You'll work at the intersection of Generative AI, large-scale ML infrastructure, and search relevance at massive scale.
Responsibilities
- Build and scale a multi-agent orchestration platform that autonomously executes research workflows — from hypothesis generation and experiment design through training, evaluation, and production deployment — with fault tolerance, cost controls, and security compliance
- Develop AI-first Auto Research systems that parallelize hypothesis testing across compute, incorporating tournament-based proposal filtering and human-in-the-loop review to dramatically increase scientist throughput
- Own platform reliability and developer experience, including multi-tenant GPU scheduling, observability, eval frameworks, and knowledge services — ensuring agents and scientists operate on a stable, extensible foundation
- Productionize LLM/VLM models with a focus on efficiency, throughput, and low-latency serving
- Collaborate with scientists and engineers to design and build data pipelines for processing massive datasets and scaling ML and LLMs
- Provide architectural guidance and technical leadership to ensure solutions deliver measurable improvements in customer-perceived relevance
Qualifications
Minimum
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 1+ years of software development engineer or related occupational experience
- 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
- 1+ years of Object Oriented Design experience
- Experience programming with at least one software programming language
Preferred
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
- Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques
- Experience using managed ML/AI solutions