Senior Production Engineer, Managed AI

Job summary

Responsibilities

At Crusoe, our Production Engineering team ensures the reliability and scalability of Crusoe’s AI-optimized cloud platform. We’re looking for a Senior Production Engineer with a strong background in distributed systems and hands-on experience with large language models to help us build and operate…

• Design and operate reliable managed AI services with a focus on serving and scaling LLM workloads
• Build automation and reliability tooling to support distributed AI pipelines and inference services
• Define, measure, and improve SLIs/SLOs across AI workloads to ensure performance and reliability targets are met
• Collaborate with AI, platform, and infrastructure teams to optimize large-scale training and inference clusters
• Automate observability by building telemetry and performance tuning strategies for latency-sensitive AI services

What they're looking for

• Strong software engineering background — experience building production-grade systems beyond scripting or Bash
• Demonstrated experience in distributed systems design and implementation
• Hands-on work with large language models (LLMs) or AI/ML infrastructure
• SRE mindset and experience (whether or not under the SRE title) including:
• Defining and measuring SLIs/SLOs

Tech stack

• Python
• Go
• Java
• C++
• Kubernetes