Software Engineer - Voice AI (Inference Runtime)

Job summary

Responsibilities

Voice is becoming the internet’s next interface, but a production-grade Voice AI system is "hard to build". You’ll join a small founding team of Baseten Voice AI, focused on bringing state-of-the-art open source models into production for Voice AI customers across productivity, customer service…

• Own and lead Voice AI product areas end-to-end - from architecture and system design through implementation, rollout, and long-term production operations.
• Design, build, and operate real-time, large-scale, high-performance model serving systems for STT, TTS, and voice agent workloads for mission-critical customer deployments
• Drive cross-team collaboration with sister engineering teams to solve full-stack technical problems, align on priorities, and coordinate end-to-end delivery across the product…
• Mentor teammates through code reviews, design docs, and technical leadership.

What they're looking for

• Bachelor's degree or higher in Computer Science or related field
• Proven track record owning production-grade real-time, large-scale systems where tail latency (p99) matters.
• Proficient coding abilities in one or more popular programming or scripting languages; Python proficiency is a plus.
• Good taste in product, particularly developer-oriented tools
• Interest in ML/AI infrastructure and willingness to learn

Tech stack

• Spark
• Python
• Docker
• Kubernetes
• vLLM
• PyTorch