Lead/Manager Together Cloud Infrastructure

Job summary

Responsibilities

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.

• Work on a distributed GPU scheduling system for the on-demand clusters product, Instant Clusters.
• Build out a global management plane for managing our data center compute, networking, and storage.
• Design and build new customer-facing cloud platform services, delivering killer enterprise AI cloud features.
• Lead/Manage a team of 8 together cloud Infrastructure Engineer in Amsterdam,
• Identify, design, and develop foundational backend services that power Together’s commerce platform

What they're looking for

• Ideally 1-2 years of leading the Infrastructure team.
• Demonstrable background in acquiring talent and retaining talent.
• 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices
• Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
• Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members

Tech stack

• Kubernetes
• AWS
• Azure
• GCP
• PostgreSQL
• Go
• Airflow
• Kafka