Software Engineer, Infrastructure

Job summary

Responsibilities

We're hiring a Software Engineer, Infrastructure to design and build the distributed systems that power our model training and serving platforms. You'll work on the systems underlying everything we do — from the clusters that train our frontier models with Inkling, to the multi-tenant serving…

• Design, build, and operate distributed systems that support large-scale model training and inference across thousands of accelerators
• Build and maintain core infrastructure, including orchestration, scheduling, storage, and resource management systems
• Improve the reliability, performance, and observability of infrastructure used across research and product teams
• Partner with researchers and platform engineers to understand infrastructure needs and turn them into robust, well-abstracted systems
• Debug and resolve complex distributed failures across the stack, from networking and storage to compute and scheduling

What they're looking for

• Demonstrated expertise designing and developing large-scale distributed systems
• Strong proficiency in Python and Go
• Experience building, deploying, and operating production infrastructure at scale
• Solid grounding in distributed systems fundamentals, such as consensus, consistency, fault tolerance, and networking
• Experience with ML infrastructure, such as training orchestration, job schedulers, or distributed storage and data systems

Tech stack

• Python
• Go
• Kubernetes