Baseten logo
Baseten Posted 10d ago

Product Manager, Inference Experience

Location

San Francisco

Hybrid

Contract

Permanent

Full-time

Salary

$200–400k

Gross per year

Experience

Not specified

Job summary

Responsibilities

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to…

  • Own product strategy and roadmap across Baseten's inference offerings, with a focus on developer adoption and business impact
  • Make it easier for developers to discover, evaluate, deploy, and manage AI models through our APIs, SDKs, CLI, and console
  • Work with inference engineers and researchers to turn technical advances into compelling customer-facing capabilities
  • Help determine which models, workloads, and customer needs we prioritize
  • Partner with GTM and leadership on pricing, packaging, launches, and commercialization

What they're looking for

  • 10+ years building and shipping AI/ML products or platforms
  • A technical background in software engineering, ML engineering, research, or equivalent hands-on experience
  • Direct experience building or deploying models using technologies like PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo, or similar frameworks
  • Strong understanding of model serving, GPU economics, and the tradeoffs between quality, latency, throughput, and cost
  • Exceptional developer product instincts. You know how to make complex technology approachable without sacrificing power

Tech stack

Read the full job posting

This summary is written by Tokn from the original posting. Only the posting published by Baseten is authoritative. Request a removal

jobs.ashbyhq.com ↗