Senior Machine Learning Engineer

Job summary

Responsibilities

As a Senior Machine Learning Engineer at Ambience, you will build and improve the AI systems that power our clinical products. You’ll own complex projects end-to-end, from diagnosing production failures and designing evaluations to building, deploying, and iterating on model and agentic systems.

• Build Trustworthy AI Evaluation Systems: Design and own evaluation pipelines for LLM and agentic systems, combining automated graders, regression testing, production feedback…
• Improve Production Model Behavior: Diagnose high-impact failure modes and test improvements across prompting, retrieval, context, routing, data, fine-tuning, or other model and…
• Build Agentic AI Systems: Develop production systems involving tool use, retrieval, context and state management, routing, orchestration, tracing, and failure recovery.
• Build Data and Improvement Flywheels: Turn production failures and user feedback into better datasets, evaluations, and model behavior through active learning and systematic…
• Stay at the Cutting Edge: Distill insights from recent research in LLMs, agents, NLP, speech, and multimodal AI and translate promising ideas into practical experiments.

What they're looking for

• Strong Production AI Experience
• Deep Evaluation Experience
• Agentic Systems Experience
• Production-Grade Software Engineer
• Data-Centric AI Developer

Tech stack

• Transformers
• Python
• PyTorch