Software Engineer - AI Developer Productivity

Job summary

Responsibilities

Baseten's engineers want to work in an AI-first way. What's missing isn't enthusiasm — it's the platform underneath it. Today everyone assembles their own agent config, context files, and MCP servers, so the good patterns stay trapped in individual setups instead of becoming defaults everyone…

• Own the internal AI developer platform end to end — architecture, build, rollout, operation, measurement.
• Evaluate and integrate third-party AI coding tools (Claude Code, Cursor, Codex, and whatever ships next quarter), and build the context layer that makes them work against our…
• Build frameworks that let other engineers create their own agents without deep LLM expertise.
• Establish the evaluation practice for AI-assisted development at Baseten, and use it to drive investment decisions.
• Drive adoption through developer experience — good defaults, clear docs, low friction — not mandate.

What they're looking for

• Have 4+ years of relevant industry experience building and enabling AI native SDLC
• Strong proficiency in Python and/or Go, building tools other engineers depend on daily.
• Hands-on experience with LLMs and agent frameworks — tool calling, MCP, context management, orchestration, failure handling.
• Deep personal fluency with AI coding tools and well-formed opinions about where they break down.
• Platform mindset: you build for adoption and self-service, treat internal engineers as customers, and would rather ship a good default than write a style guide.

Tech stack

• Spark
• Python
• Go
• Kubernetes
• Docker