About the job
The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on AWS Trainium, Amazon's custom machine learning accelerator. Neuron includes an ML compiler, runtime, collectives library, and application framework that integrate with PyTorch and JAX, so customers can train frontier-scale models on Trainium without rewriting their stack.
Responsibilities
- Lead the effort to build distributed training and post-training support into PyTorch and JAX for Trainium accelerators."pathways, and context parallelism, and apply reduced-precision formats where they measurably pay off.\
Qualifications
Minimum
- 5+ years of non-internship professional software development experience\n- 5+ years of programming with at least one software programming language experience\n- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience\n- Experience as a mentor, tech lead or leading an engineering team\n- Bachelor's degree or above in computer science or equivalent
Preferred
- Master's degree or above in computer science or equivalent\n- Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware, or experience in computer architecture\n- Hands-on SFT and/or RLHF/PPO/DPO experience\n- Experience with ML frameworks such as Pytorch/Jax, Distributed libraries and Frameworks, RL frameworks or End-to-end Model Training\n- Experience with performance engineering: workload profiling, characterization (compute bound, memory bound, network bound), and optimization\n- Contribution to open source projects