Staff ML Engineer, Frontier AI

Job summary

Responsibilities

As a Staff Machine Learning Engineer at Ambience, you will help set the technical direction for the AI systems that power our clinical products. You’ll identify the highest-impact opportunities to improve model behavior, evaluation, post-training, and agentic systems, and lead the design and…

• Define the AI Quality and Evaluation Strategy: Establish how we measure production AI quality across LLM and agentic systems, including automated graders, regression testing…
• Drive Production Model Improvement: Identify high-impact failure modes across products and lead improvements across prompting, retrieval, context, routing, data, and…
• Advance Post-Training Capabilities: Shape how Ambience uses techniques such as supervised fine-tuning, preference optimization, reinforcement learning, distillation, and…
• Architect Agentic AI Systems: Set technical direction for production systems involving tool use, retrieval, context and state management, routing, orchestration, tracing, and…
• Build Self-Improving AI Loops: Design the systems that turn production failures and user feedback into better datasets, evaluations, and model behavior, creating scalable…

What they're looking for

• Expert in Production AI Systems
• Deep Evaluation Rigor
• Agentic Systems Expertise
• Post-Training and Model Improvement Expertise
• Production-Grade Software Engineer

Tech stack

• Transformers
• Python
• PyTorch