Posted 1d ago

Baseten Posted 10d ago
Product Manager, Inference Platform
Location
San Francisco
Hybrid
Contract
Permanent
Full-time
Salary
$200–400k
Gross per year
Experience
Not specified
Job summary
Responsibilities
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to…
- Work with inference engineering and research teams to bring new performance capabilities to customers.
- Translate advances in batching, caching, quantization, speculative decoding, and serving architectures into useful product features.
- Define benchmarks and evaluations that demonstrate meaningful improvements in latency, throughput, quality, and cost.
- Understand customer workloads and help prioritize the optimizations that will have the greatest impact.
- Make performance features easier to configure, evaluate, and adopt in production.
What they're looking for
- Experience building and shipping AI/ML products or infrastructure, particularly where performance, scalability, or production behavior mattered.
- A technical background in software engineering, ML engineering, research, or equivalent hands-on experience.
- Strong understanding of model serving architectures, GPU economics, and latency, throughput, quality, and cost tradeoffs.
- Experience working closely with researchers or infrastructure engineers to bring technically complex capabilities into production.
- A rigorous approach to benchmarking, experimentation, and performance measurement.
Tech stack
Read the full job posting
This summary is written by Tokn from the original posting. Only the posting published by Baseten is authoritative. Request a removal
Similar jobs
All AI Product & Design jobs in San Francisco →Posted 1d ago
Posted 1d ago


