Backend Engineer - API

Job summary

Responsibilities

As an ideal candidate you have a good understanding of how highly scalable and reliable production infrastructure is built. Most of our backend infrastructure is written in Rust. So familiarity with a compiled language such as C++, Rust, or Go is highly beneficial.

• Build the SpaceXSI API that serves our models to developers worldwide
• Own the end-to-end system responsible for high-throughput inference, handling billions of tokens per minute with low latency and high availability, including model serving…

What they're looking for

• Expert knowledge of either Rust or C++
• Experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems
• Knowledge of service observability and reliability best practices
• Experience in operating commonly used databases such as PostgreSQL, Clickhouse, and MongoDB
• Experience with LLM inference engines and serving frameworks (e.g., SGLang, TensorRT, vLLM)

Tech stack

• Rust
• C++
• PostgreSQL
• vLLM
• Docker
• Kubernetes