Software Engineer, AI Infrastructure

Glean
Mountain View, CA, USA2024-11-26

About the job

Glean is looking for software engineers to help build the world's best search and assistant product for work. Our engineers work on a range of systems across the stack, including generative AI, RAG, query understanding, document understanding, domain-adapted language models, natural language question-answering, evaluation, and experimentation. We interact regularly with customers, deeply understand their pain points, and use whatever tool is necessary, simple or complex, to solve their problems.

Responsibilities

Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale.

Work with and enable other engineers focused on modeling and Agentic capabilities

Build agentic systems that leverage AI to proactively monitor, diagnose, debug and maintain infrastructure health at scale across cloud deployments

Write robust code that's easy to read, maintain, and test

Mentor more junior engineers, or learn from battle-tested ones

Qualifications

Minimum

2-5 years of experience

BA/BS in computer science, math, sciences, or a related degree

Proven ability to design, build, and ship production-ready software, ideally around AI/ML infrastructure (Batch processing pipelines, Serving infrastructure, LLM orchestration etc.)

Strong coding skills (Python, Go, Java)

Thrive in a customer-focused, tight-knit and cross-functional environment — being a team player and willing to take on whatever is most impactful for the company is a must

A proactive and positive attitude to lead, learn, troubleshoot and take ownership of both small tasks and large features

Preferred

No preferred qualifications listed.