Staff Software Engineer, Platform Infrastructure (Foundations)

Job summary

Responsibilities

Anyscale is seeking a Staff Software Engineer to lead the technical vision for our Infrastructure team. As a Staff Engineer, you will be responsible for the architectural evolution of our control plane and data plane, ensuring that our "infinite laptop" vision scales to meet the most demanding…

• Architectural Leadership: Define and drive the multi-year technical roadmap for services that orchestrate Ray clusters across diverse cloud and on-premises environments.
• Systemic Optimization: Lead the design and optimization of high-performance control plane components specifically tailored for large-scale, heterogeneous AI/ML workloads.
• Platform Reliability: Establish the organization-wide standards for the reliability, scalability, and observability of Anyscale-managed infrastructure.
• Strategic Integration: Direct the long-term strategy for accelerator integration (GPUs, TPUs) and container management to ensure seamless execution of distributed workloads.
• Technical Governance: Lead complex design and architecture discussions, resolving deep technical debt and ensuring engineering excellence across the organization.

What they're looking for

• Experience: 5+ years of experience writing high-quality production code and leading complex distributed systems projects.
• Architectural Depth: Proven track record of designing and maintaining highly available, scalable, and secure cloud-native platforms (AWS, Azure, or GCP).
• Kubernetes Mastery: Deep expertise in Kubernetes-based deployments and container orchestration at massive scale.
• System Foundations: Advanced knowledge of Linux kernel, networking, and low-level operating system foundations.
• Technical Proficiency: Mastery of Go and Python, with the ability to set coding standards and best practices for the team.

Tech stack

• Ray
• Kubernetes
• AWS
• Azure
• GCP
• Go
• Python