Staff Engineer, Distributed Storage and HPC & AI Infrastructure

Job summary

Responsibilities

In this role, you will operate, scale, and optimize multi-petabyte storage systems purpose-built for the world’s largest AI training and inference workloads. You’ll manage and scale high-performance parallel filesystems and object stores, evaluate and integrate cutting-edge technologies such as…

• Architect and implement the technical strategy and storage roadmap for Together AI, driving high-performance architectural decisions as we scale our GPU fleet.
• Engineer and scale multi-petabyte AI/ML storage systems by integrating Vast, Weka, and Ceph while executing deep cost optimization through automated tiering and lifecycle policies.
• Develop intelligent caching and tiered storage architectures to achieve extreme IOPS and cluster-wide throughput at GPU scale for training and inference workloads.
• Tune storage isolation at the L2/L3 network layers to ensure secure, production-grade multi-tenancy for storage clients.
• Code Kubernetes storage operators and controllers to enable automated provisioning, self-service abstractions, and quota enforcement.

What they're looking for

• 8+ years in storage engineering, managing distributed storage at multi-petabyte scale
• Proven track record deploying and operating high-performance storage for GPU/HPC clusters
• Deep Kubernetes and cloud-native storage experience in production environments
• Strong coding skills in Go and Python with demonstrated ability to build production-grade systems and tooling
• BS/MS in Computer Science, Engineering, or equivalent practical experience

Tech stack

• Kubernetes
• Go
• Python
• Terraform