Senior Software Engineer — Infra Agent Systems

Job summary

Responsibilities

Together AI runs one of the largest GPU fleets in the world. The Infra Agent Systems team builds the software systems that power and automate that infrastructure.

• Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across one of the world’s largest GPU fleets.
• Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents.
• Develop fleet intelligence systems that combine telemetry, infrastructure state, operational knowledge, and historical incidents to help agents make better decisions.
• Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through well-designed APIs.
• Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations.

What they're looking for

• 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms.
• Strong systems design skills and experience owning significant systems from design through production.
• Depth in at least one of the following:
• AI agent systems, orchestration, tool use, evaluation, or grounding
• Knowledge graphs or graph data modeling

Tech stack

• RAG
• Kubernetes
• Go
• TypeScript
• Python
• Rust
• Kafka