Data Engineer, Data Quality & Provenance

Job summary

Responsibilities

Wayve is not a mature, fully-structured place with the playbook already written. Much of how we work is still being written, and if you join, you’ll help write it. That suits people who want real ownership more than people who need a settled structure from day one.

• Design and operate scalable batch and streaming pipelines for multimodal fleet and simulation data.
• Build data models, catalogues, indexes and query capabilities that make sensor, vehicle-state, map and event data easy to discover and use.
• Create versioned, reproducible datasets for training, evaluation, replay, scenario mining and safety analysis.
• Develop workflows for data ingestion, synchronisation, transformation, curation, labelling and quality validation.
• Partner with autonomy, ML, simulation and safety engineers to define schemas, APIs and data contracts.

Tech stack

• Python
• SQL
• Spark
• Airflow