Engineering Manager, Ray Data

Job summary

Responsibilities

Anyscale is looking for an engineering leader to manage the open source Ray Data team. Ray Data is the Python-native data processing engine for AI workloads on Ray. It handles multimodal and structured data and powers batch inference, data loading for distributed training, and large-scale…

• The streaming execution engine, including scheduling, backpressure, and resource management across CPUs and GPUs
• Batch inference for LLMs and multimodal models, including integrations with inference engines such as vLLM
• Data loading for production training workloads with Ray Train and popular ML frameworks
• Connectors for data sources and formats such as Parquet, Iceberg, Delta Lake, Lance, and cloud object storage
• Performance, stability, and fault tolerance at large scale

What they're looking for

• 7+ years of software engineering experience, including 2+ years directly managing engineers, ideally at a high-growth startup
• A record of building high-performing distributed teams and helping them scale quickly while maintaining a good culture
• Experience with building and managing teams across geographic locations, preferably in US and India
• Ability to keep a high hiring bar, motivate the team, coach and mentor engineers, and handle performance management issues
• Deep technical knowledge of distributed systems and data-intensive systems, such as data processing engines, query engines, or database internals

Tech stack

• Ray
• Python
• vLLM
• Spark
• Azure
• GCP