Senior Software Engineer - AI Compute, Together Cloud

Job summary

Responsibilities

Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure.

• Build the GPU and network virtualization stack: the hypervisor, kernel, and SDN work that makes GPU compute and DC networking high-performance, portable, and strongly isolated…
• Build and maintain our in-DC IaaS layer: the services, Kubernetes operators, and libraries that provision and manage compute, storage, and networks in our data centers, including…
• Scale the distributed GPU scheduling and global management plane: the control-plane services behind on-demand and reserved clusters, including the automation that onboards new…
• Harden the monitoring and automated remediation layer for fault tolerance: automated detection, isolation, and recovery of failed nodes that keeps distributed pretraining and…
• Own your components end-to-end: write the design docs, break the work into milestones that ship incrementally, and improve the reliability of what's already in production.

What they're looking for

• 5+ years of professional software development experience, with strong proficiency in at least one backend programming language (Golang desired).
• Demonstrated ownership of large-scale projects driven end-to-end to completion, writing high-performance, well-tested, production-quality code.
• Demonstrated experience building and operating high-performance and/or globally distributed micro-service architectures across one or more cloud providers (AWS, Azure, GCP).
• Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale.
• Excellent communication skills — able to write clear design docs and work effectively with both technical and non-technical team members.

Tech stack

• Kubernetes
• Go
• AWS
• Azure
• GCP
• Terraform
• CUDA