Principal Cloud Platform Engineer

Job summary

Responsibilities

As a Principal Cloud Platform Engineer, you will be specializing in our AI Inferencing Service and will be the guardian of its reliability, performance, and scalability. You will bridge the gap between software development and operations, applying an engineering mindset to solve operational…

• Shared ownership of the production inferencing service across regions, covering availability, latency, performance, change management, and capacity planning
• Standing-up and automating AI infrastructure in new regions
• Participating in a shared primary/secondary on-call rotation, and leading incident response
• Building monitoring, alerting, and dashboards in Prometheus, Grafana, and Datadog for service health, model latency and throughput, and accelerator utilization
• Finding and eliminating performance bottlenecks

What they're looking for

• B.S. in Computer Science, Computer Engineering, or related field
• 5+ years of experience in a Site Reliability Engineering, DevOps
• Experience supporting a large-scale, customer-facing service in a public cloud environment (AWS, GCP, Azure)
• Strong programming and scripting skills in languages like Python, Go, Rust, or Java
• Proven experience with containerization and orchestration technologies (Docker and Kubernetes)

Tech stack

• Terraform
• AWS
• GCP
• Azure
• Python
• Go
• Rust
• Java