Together AI logo
Together AI Posted 11d ago

Engineering Manager, Kubernetes Bare Metal Infrastructure

Location

San Francisco

Contract

Permanent

Full-time

Salary

$300–350k

Gross per year

Experience

Lead

Lead level

Job summary

Responsibilities

We are hiring an Engineering Manager/Tech Lead Manager to lead the team that runs Kubernetes on bare-metal GPU infrastructure at Together AI. You will own how thousands of GPUs across our data centers are provisioned, orchestrated and kept healthy for the customers training, fine-tuning and…

  • Set the technical direction for how we run Kubernetes on bare metal across multiple data centers and regions.
  • Drive automated, zero-touch provisioning of GPU nodes, from firmware and OS imaging through cluster join and validation.
  • Own cluster lifecycle at scale: upgrades, capacity expansion, node health checks, automated remediation and decommissioning.
  • Make GPU scheduling, topology-aware placement and high-performance networking (InfiniBand, RoCE, RDMA) first-class in the platform.
  • Define and meet SLOs for cluster availability, node bring-up time and GPU utilization.

What they're looking for

  • 8+ years in infrastructure, SRE or platform engineering, including 2+ years managing engineers.
  • Deep hands-on experience running Kubernetes in production at scale, ideally on bare metal rather than only managed services.
  • Solid grounding in Linux systems, networking and hardware: kernels, drivers, BIOS/BMC, PXE boot and out-of-band management.
  • Experience building automation for fleet provisioning and lifecycle with tools such as Cluster API, Metal3, Ironic, MAAS, Ansible or Terraform.
  • A track record of owning production systems with on-call, SLOs and incident response.

Tech stack

Read the full job posting

This summary is written by Tokn from the original posting. Only the posting published by Together AI is authoritative. Request a removal

job-boards.greenhouse.io ↗