Software Engineer, RL Data

Job summary

Responsibilities

The data behind a model shapes it more than almost anything else. On the RL Data team at SpaceXAI, you decide what that data is for our agents: which problems they practice, what world they practice in, and how they're judged.

• Turning a capability gap into thousands of verifiable tasks — for example, planting subtle bugs deep in a real project's dependencies for the agent to root-cause.
• Building environments that behave like production: real codebases with their real dependencies, and simulations of apps like email, calendar, and docs that match the real ones…
• Designing graders for open-ended work that separate good solutions from bad without penalizing valid alternatives or rewarding shortcuts.
• Building automated checks that catch reward hacking, leaked answers, broken environments, and paths the real product wouldn't allow, before data reaches training.
• Scaling from a thousand hand-checked tasks to millions, with filters and judges you can trust in place of a person reading each one

Tech stack

• Python