AI Inference Engineer

Job summary

Responsibilities

As a Forward Deployed Engineer at Baseten, you will partner directly with customers to architect, build, and deploy high-scale production AI applications on Baseten’s platform. You’ll own the journey with customers from initial exploration to production deployment, translating ambiguous business…

• Develop and maintain software systems and product features using one or more general-purpose programming languages in a production-level environment, with a preference for Python…
• Drive customer impact by designing, implementing, and deploying Baseten solutions end-to-end (problem framing → evaluation → production deployment → monitoring).
• Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs so we can rapidly ship well-tested services and outcomes for our customers
• Optimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack. This includes developing features and PRDs with other engineering and…
• Own products and customer projects end-to-end, functioning as both an engineer, project manager, and product manager, with a focus on user empathy, project specification, and…

What they're looking for

• Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.
• 2+ years of professional work experience in a fast-paced, high-growth environment.
• Demonstrated experience with one or more general-purpose programming languages in a production-level environment, with a strong preference for Python.
• Familiarity with AI/ML pipelines and the lifecycle of ML model development and deployment.
• Strong communication skills, particularly on complex technical topics.

Tech stack

• Spark
• Docker
• Python