Software Engineer, AI/ML Infrastructure

Job summary

Responsibilities

Glean is looking for software engineers to help build the world's best search and assistant product for work. Our engineers work on a range of systems across the stack, including generative AI, RAG, query understanding, document understanding, domain-adapted language models, natural language…

• Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale
• Work with and enable other engineers focused on modeling and Agentic capabilities
• Build agentic systems that leverage AI to proactively monitor, diagnose, debug and maintain infrastructure health at scale across cloud deployments
• Write robust code that's easy to read, maintain, and test
• Mentor more junior engineers, or learn from battle-tested ones

What they're looking for

• 2-6 years of experience
• BA/BS in computer science, math, sciences, or a related degree
• Proven ability to design, build, and ship production-ready software, ideally around AI/ML infrastructure (Batch processing pipelines, Serving infrastructure, etc.)
• Strong coding skills (Python, Go, Java)
• Thrive in a customer-focused, tight-knit and cross-functional environment — being a team player and willing to take on whatever is most impactful for the company is a must

Tech stack

• RAG
• Python
• Go
• Java