Senior/Staff Software Engineer (Back-End), Inference

Job summary

Responsibilities

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

• Evolve and scale the backend systems that power Model Vault, including authentication and authorization, deployment management, billing, metering, and customer lifecycle.
• Lead major architectural initiatives across identity, payments, usage systems, platform scalability, and other core product foundations.
• Build highly reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platforms.
• Design APIs and distributed systems with strong guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observability.
• Build security and privacy into the platform architecture, including tenant isolation, least-privilege access, auditability, secrets management, encryption, and confidential…

Tech stack

• Go
• Python
• Java
• C++
• Rust