Software Engineer, RL Inference

Job summary

Responsibilities

The RL infrastructure team is looking for an engineer to help with low precision RL training and inference.

• Design and optimize our inference stack for all shapes of RL workloads at SpaceXSI, from small scale ablations to production training runs
• Analyze, profile and address performance bottlenecks in large scale RL systems
• Work closely with the modeling team to efficiently implement novel RL techniques and algorithms

What they're looking for

• Experience in building, debugging, and optimizing efficiency of large-scale distributed systems
• Experience in LLM inference
• Proficiency in programming languages such as Python, C++ and/or Rust, and frameworks such as PyTorch, Jax, CUDA
• Strong knowledge in quantization and numerics in LLM inference and training
• Experience in developing inference engines, e.g. SGLang, vLLM

Tech stack

• Python
• C++
• Rust
• PyTorch
• JAX
• CUDA
• vLLM