Software Engineer, Pretraining Data

Job summary

Responsibilities

We’re looking for Software Engineers to build the data systems behind our frontier coding models’ initial training. You’ll work on large-scale crawling, data platform, and pipeline infrastructure, turning raw dumps into the datasets our models train on, and making iteration with researchers fast…

• The Data Quality team owns the entire road between raw internet-scale data and the tokens that train frontier models.
• The Data Platform Team owns the infrastructure and pipelines that transform raw data dumps into training-ready datasets.
• The Crawling team owns large-scale web crawling and parsing that feeds the top of the funnel for initial training.
• on the Data Quality Team:
• Build and own high-throughput, fully telemetered data pipelines that process frontier-scale data with end-to-end traceability.