Staff Applied Scientist - Dashboards

Job summary

Responsibilities

At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

• Own the evaluation strategy for Dashboards, as well as sister teams within our organization. Define the metrics — offline and online, quality and cost, single-turn and multi-turn…
• Build the eval datasets, golden traces, and regression harnesses that catch quality changes before they hit customers, and make those assets reusable by every team that is…
• Drive measurable improvements to retrieval relevance, tool-selection accuracy, and context efficiency, partnering closely with the engineers on the team.
• Provide technical leadership across the Dashboards team and the broader organization through design reviews, working groups, and mentorship.

What they're looking for

• You have a BS/MS/PhD in a scientific field, or equivalent experience.
• 10+ years of relevant engineering or applied science experience, including time as a technical lead.
• Proven track record of leading ML or GenAI initiatives in a product-driven environment, from research through production.
• Significant experience with evaluation, experimentation, or measurement of ML systems at scale.
• You bring a strong product mindset and are comfortable driving initiatives across cross-functional teams.