Engineering Manager, Model Infrastructure

Job summary

Responsibilities

As the Engineering Manager for Model Infrastructure, you'll lead the team responsible for the platform powering every model request across Harvey. You'll partner closely with AI Research, Product Engineering, Infrastructure, and external AI providers to ensure our platform remains reliable…

• Lead and grow a high-performing team of software engineers responsible for Harvey's Model Infrastructure platform.
• Define the technical roadmap for model reliability, scalability, and operational excellence.
• Build highly reliable systems for model provisioning, capacity management, failover, and incident response across multiple AI providers.
• Own Harvey's multi-provider model platform, including provider integrations, SDK upgrades, API migrations, and onboarding new model providers.
• Drive the evolution of our Unified Model Controller (UMC) and Model Selector platform to automatically detect degraded models and intelligently route traffic based on health…

What they're looking for

• 8+ years of software engineering experience, including multiple years managing high-performing engineering teams.
• Experience leading teams responsible for large-scale distributed systems or cloud infrastructure.
• Strong technical background that enables you to guide architectural decisions and mentor senior engineers.
• Experience operating highly available production services with strong reliability and operational excellence.
• Experience building platforms that require scalability, observability, automation, and cost optimization.

Tech stack

• Azure
• Kubernetes
• Spark
• Kafka
• Airflow