Software Engineer, Data Infrastructure

Job summary

Responsibilities

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

• Design, build, and operate the distributed storage system that feeds model training and evaluation.
• Run this system multiple on Kubernetes clusters at petabyte scale.
• Work with researchers and training-infra teams on how jobs actually read and write data, and turn that into throughput, latency, and durability requirements
• Work through the networking, I/O, and consistency problems of moving large datasets and checkpoints across regions and backends, with GPU idle time and time-to-insight as the…

What they're looking for

• Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management.
• Strong coding ability. We work in Python and Go; experience in either is enough, but you should be willing to pick up the other
• Experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets.
• Hands-on experience with cloud object storage such as S3 as well as POSIX-style filesystems.

Tech stack

• Kubernetes
• Python