Customer Engineer, Infrastructure

Job summary

Responsibilities

The Customer Engineer will play a crucial role in the customers’ post-sale journey - helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets and driving consumption.

• Resolve customer issues and help in their successful adoption of Anyscale platform
• Be a technical advisor, and internal champion for our key customers
• Own customer issues end-to-end, from troubleshooting, triaging, escalations and eventual resolution
• Participate in our follow-the-sun customer support model to ensure continuity in resolving high priority tickets
• Keep track of open customer bugs and feature requests to influence prioritization and provide timely customer updates upon resolution

What they're looking for

• 7+ years of experience in a Machine Learning role in a dynamic, fast-paced, startup-like environment
• Strong organizational skills and ability to manage multiple customer needs simultaneously
• Proficient at developing data pipelines for training, fine-tuning and inference/serving of LLMs
• Experience running and optimizing infrastructure for distributed ML workloads on the major cloud platforms (AWS/EKS, GCP/GKE or Azure/AKS)
• Excellent communication and interpersonal skills.

Tech stack

• Ray
• vLLM
• AWS
• GCP
• Azure
• Kubernetes
• Terraform