Staff+ Software Engineer, ML Inference Path

Job summary

Responsibilities

The Safeguards ML Inference Path team designs, builds, and operates the production infrastructure that powers Claude's ML based safety systems. We collaborate closely with safety researchers and inference engineers to bring new classifiers and novel classes of ML defenses to production.

• Design and build scalable ML infrastructure to support real-time safety deployments across our classifier and model ecosystem
• Build monitoring and observability tools to track classifier performance, data quality, and system health for safety-critical applications
• Collaborate with research teams to productionize safety research, translating experimental safety techniques into robust, scalable systems
• Optimize inference latency and throughput for real-time safety evaluations while maintaining high reliability standards
• Implement automated testing, deployment, and rollback systems for ML models in production safety applications

What they're looking for

• Have 5+ years of experience building production ML infrastructure, ideally in safety-critical domains like fraud detection, content moderation, or risk assessment
• Working with large language models and modern transformer architectures
• Developing monitoring and alerting systems for ML model performance and data drift
• Experience in trust & safety, fraud prevention, or content moderation domains
• Knowledge of privacy-preserving ML techniques and compliance requirements

Tech stack

• Python
• PyTorch
• TensorFlow
• JAX