Principal Product Manager Technical, AWS Applied AI Solutions - Core Services

As part of the AWS Applied AI Solutions organization, we have a vision to provide business applications, leveraging Amazon's unique experience and expertise, that are used by millions of companies worldwide to manage day-to-day operations. We will accomplish this by accelerating our customers' businesses through delivery of intuitive and differentiated technology solutions that solve enduring business challenges. We blend vision with curiosity and Amazon's real-world experience to build opinionated, turnkey solutions.

We are looking for a Principal Product Manager, Technical to own and drive the product strategy, revenue, and adoption for AI Agent Evaluations within our Core Services AI Foundations team. You will be responsible for defining the long-term vision and building the business around evaluation capabilities that enable development teams to measure, benchmark, and continuously improve the quality, safety, and reliability of their AI powered agents. This includes owning the full product lifecycle from concept through GTM for evaluation tooling, quality scoring methodologies, regression testing frameworks, and human review workflows. You will own one or more products in production while also getting in on the ground floor of new projects that bring evaluation capabilities to customers worldwide.

• Lead product definition for AI agent evaluation capabilities, owning the customer working backwards strategy, tenets, long term goals, and working backwards documents including customer and market feedback, competitive analysis, and business metrics to inform direction

• Define product vision including all aspects of future roadmap, investment, innovation, and experimentation for automated evaluation pipelines, human review workflows, and quality benchmarking tools

• Own execution of product planning and development including customer goals and business requirements for product releases, ensuring implementation is aligned with product goals, and ownership of product positioning

• Lead product launches owning GTM plans that deliver results ensuring customer and business goals are met in operational launch plans

• Create and revise GTM strategy and be responsible for pricing new features and updating pricing for existing features working closely with finance

• Work with field and BD teams to create customer funnel and drive POC to pilot to production motions

• Be responsible for creating and reporting on the service's revenue and customer traction through weekly and monthly business reports shared with leadership

• Partner with applied scientists and engineers to translate research into production grade product features

• Drive alignment across dependent teams (identity, observability, data platform) to ensure evaluation signals integrate seamlessly with the broader Core Services AI Foundations platform

• Lead interaction with the technical team including helping make tradeoffs based on customer requirements and QA/testing of the product