Staff Product Manager, AI Inference

Job summary

Responsibilities

As the Staff Product Manager - AI Inference, you will lead CoreWeave's strategic efforts in shaping and developing cutting-edge AI inference services that drive innovation and business outcomes for our customers.

• Product Vision and Strategy: Help refine the product strategy for AI application cloud services aimed at foundational model Inference, along with focus on optimization across the…
• Roadmap Development: Own the product roadmap for AI inference services, balancing near-term customer needs with long-term vision, to deliver differentiated and scalable AI cloud…
• AI and Cloud Expertise: Stay current on advancements in AI/ML technologies including inference engines, model serving architectures, cloud infrastructures, and software…
• Define product portfolio: Manage ambiguity and complexity of a fast evolving AI landscape to define new product investments and develop a portfolio of inference capabilities that…
• Customer Engagement: Collaborate with key customers to understand their AI workloads, pain points, and future requirements to continuously improve our service offerings.

What they're looking for

• Experience: 8+ years of experience in product management, with at least 5 years in the cloud services or AI/ML market segment.
• Technical Knowledge: Hands on practitioner and deep understanding of AI/ML workloads including foundation model inference, inference engines such as vllm, SGLang, TensorRT-llm…
• Leadership: Proven ability to lead cross functional teams, with strong decision-making, project management, and mentoring skills.
• Customer-Centric Approach: Demonstrated experience working closely with customers to identify needs and translate them into product features and solutions.
• Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders.

Tech stack

• vLLM
• Kubernetes