Senior / Staff Software Engineer — AI Platform

Job summary

Responsibilities

We're looking for Software Engineers at Senior / Staff levels who combine strong software and distributed systems fundamentals with experience operating AI systems in production. You'll build the infrastructure that lets teams create, experiment with, evaluate, and operate LLM and agentic…

• Design and build infrastructure for running large-scale agentic workloads, including multi-step agents interacting with tools, external services, sandboxes, and simulated…
• Build scalable synthetic data generation and automated labeling systems that allow teams to create, refine, and evaluate high-quality training and evaluation datasets
• Design evaluation infrastructure for measuring AI system behavior across models, prompts, tools, environments, and multi-step trajectories - including reproducible experiments…
• Build orchestration and distributed compute systems for running thousands to millions of AI experiments and simulations reliably across heterogeneous compute environments
• Develop infrastructure for agent simulation environments, including environment provisioning, isolation, lifecycle management, and scalable execution

What they're looking for

• 5+ years building production software systems, with experience in AI/ML infrastructure, ML platforms, distributed systems, data platforms, or backend infrastructure
• Experience operating non-deterministic AI or ML workloads in production or at significant scale — you are comfortable reasoning about behavior across models, tools, environments…
• Experience building infrastructure for experimentation, evaluation, model development, synthetic data, agentic workflows, training, inference, or production ML systems
• Strong proficiency in Python and experience building production-quality APIs, services, and developer tooling
• Strong background in distributed systems and cloud platforms (AWS preferred), including compute orchestration, storage, networking, isolation, and failure handling

Tech stack

• Python
• AWS
• Airflow
• Ray
• Kubernetes