Senior Runtime Engineer

Job summary

Responsibilities

We are building the next generation of large-scale AI systems that power training and inference workloads at unprecedented scale and efficiency.

• Design and implement distributed runtime components to efficiently manage large-scale execution workloads.
• Develop and optimize high-performance data and communication pipelines that fully utilize CPU, memory, storage, and network resources.
• Enable scalable execution across multiple compute nodes, ensuring high concurrency and minimal bottlenecks.
• Collaborate closely with ML and compiler teams to integrate new model architectures, training regimes, and hardware-specific optimizations.
• Diagnose and resolve complex performance issues across the software stack using profiling and instrumentation tools.

What they're looking for

• 3+ years of experience developing high-performance or distributed system software.
• Strong programming skills in C/C++, with expertise in multi-threading, memory management, and performance optimization.
• Experience with distributed systems, networking, or inter-process communication.
• Solid understanding of data structures, concurrency, and system-level resource management (CPU, I/O, and memory).
• Proven ability to debug, profile, and optimize code across scales—from threads to clusters.

Tech stack

• C++
• Python
• PyTorch