Data Engineer

Job summary

Responsibilities

We’re hiring a Data Engineer to build and scale Baseten’s internal data platform. This role sits at the intersection of data engineering, analytics, and data science, transforming raw product and business data into reliable datasets that power decision-making.

• Design and maintain core data models and semantic layers
• Develop and orchestrate batch and streaming data pipelines using technologies such as Apache Beam, Kafka, Airflow, or similar frameworks
• Analyze inference and infrastructure telemetry, including data from OpenTelemetry, Grafana, and other observability tools
• Define and maintain company-wide metrics across product usage, performance, and customer lifecycle
• Enable self-service analytics through agents and tools, with well-structured semantic layers and context

What they're looking for

• Understanding of inference metrics such as latency, throughput, token usage, and model performance
• Experience supporting B2B SaaS and/or consumption-based platforms
• Application of forecasting and predictive modeling (e.g., ARIMA, Prophet) to business processes

Tech stack

• Spark
• Kafka
• Airflow