About the job
The Senior Software Engineer for the AI Model Lifecycle team will play a crucial role in building a comprehensive managed platform for the entire application development lifecycle, with a specific focus on leveraging Machine Learning models, including Large Language Models (LLMs).
Responsibilities
- Manage fine-tuning systems for large foundation models (SFT, PEFT, LoRA, adapters), including multi-node orchestration, checkpointing, failure recovery, and cost-efficient scaling.
- Implement and maintain end-to-end training pipelines for Large Language Models.
- RFT and Reinforcement learning to the fine tuning and training sections
- Distillation and reinforcement learning pipelines (e.g., preference optimization, policy optimization, reward modeling).
- Dataset, model, and experiment management: versioning, lineage, evaluation, and reproducible fine-tuning at scale.
Qualifications
Minimum
- Advanced degree in Computer Science, Engineering, or a related field.
- 4-5+ years of industry experience leading and driving impactful projects in the AI Space
- Experience in Generative AI (Large Language Models, Multimodal).
- Hands-on experience training, fine-tuning, and aligning LLMs using Reinforcement Learning and Reinforcement Fine-Tuning (RFT) techniques.
Preferred
- Proficiency in Golang or Python for large-scale, production-level services and PyTorch
- Contributions to open-source AI projects such as vLLM or similar frameworks.
- Performance optimizations on GPU systems and inference frameworks.