Member of Technical Staff (Answer Quality & Evals)

Job summary

Responsibilities

As our product and agent capabilities evolve, we need evaluation systems that are fast, reliable, production-faithful, and actionable. In this role, you will build and improve the technical foundations that support Answer Quality across Perplexity.

• Build shared evaluation infrastructure that helps teams run reliable evals, analyze results, and make product and model decisions
• Develop the platform for replaying and analyzing agent traces to reproduce production behavior and diagnose failures
• Build and operate scalable systems for processing, storing, and monitoring interaction, trace, and evaluation data
• Partner with data scientists, engineers, and product teams to turn answer-quality problems into evaluations, analyses, and product improvements
• Operate in a small, high-impact team where your work directly shapes how Perplexity measures and improves Answer Quality

What they're looking for

• 4+ years of software, data, or machine learning engineering experience shipping and operating production systems
• Strong proficiency in Python and SQL, with solid fundamentals in system design, data modeling, and distributed systems
• Experience building big-data systems, including distributed compute, large-scale storage, and high-volume pipelines
• Demonstrated ownership of ambiguous technical projects from initial design through production operation
• Ability to work effectively with data scientists, engineers, and product partners

Tech stack

• Python
• SQL
• Databricks
• Snowflake