Senior Machine Learning Engineer - Orchestration - Applied AI & LLMs

Job summary

Responsibilities

We are looking for a Senior Machine Learning Engineer to join the Orchestration team in AI Health Assistant.

• Define and own the evaluation strategy for our AI agentic system — metrics, protocols, datasets, and tooling
• Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations
• Run systematic experiments to assess reasoning, factuality, robustness, and user experience
• Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement
• Contribute to research and internal knowledge sharing on LLM evaluation methodologies and best practices

Tech stack

• TypeScript
• Java
• Python
• React