Baseten logo
Baseten Posted 10d ago

Product Manager, Inference Platform

Location

San Francisco

Hybrid

Contract

Permanent

Full-time

Salary

$200–400k

Gross per year

Experience

Not specified

Job summary

Responsibilities

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to…

  • Work with inference engineering and research teams to bring new performance capabilities to customers.
  • Translate advances in batching, caching, quantization, speculative decoding, and serving architectures into useful product features.
  • Define benchmarks and evaluations that demonstrate meaningful improvements in latency, throughput, quality, and cost.
  • Understand customer workloads and help prioritize the optimizations that will have the greatest impact.
  • Make performance features easier to configure, evaluate, and adopt in production.

What they're looking for

  • Experience building and shipping AI/ML products or infrastructure, particularly where performance, scalability, or production behavior mattered.
  • A technical background in software engineering, ML engineering, research, or equivalent hands-on experience.
  • Strong understanding of model serving architectures, GPU economics, and latency, throughput, quality, and cost tradeoffs.
  • Experience working closely with researchers or infrastructure engineers to bring technically complex capabilities into production.
  • A rigorous approach to benchmarking, experimentation, and performance measurement.

Tech stack

Read the full job posting

This summary is written by Tokn from the original posting. Only the posting published by Baseten is authoritative. Request a removal

jobs.ashbyhq.com ↗