Software Engineer - Dedicated Inference

Job summary

Responsibilities

As an Engineer on the Dedicated Inference team, you'll shape the state-of-the-art developer experience for deploying and operating AI workloads in production. From the CLI and SDKs to APIs, observability, and debugging workflows, you'll build the tools customers rely on every day to manage…

• Implement new features and products for the team
• Design ergonomic APIs and abstractions to solve customer problems
• Fix bugs and resolve customer issues with urgency
• Work across the stack - regardless of where you start, you’ll end up touching both React Components and Kubernetes Pods
• Work closely with the product and forward deployed engineering teams to develop and drive new product ideas

What they're looking for

• Bachelor's degree or higher in Computer Science or related field
• Proficient coding abilities in one or more popular programming or scripting languages; Python, Go, or JavaScript proficiency is a plus
• Familiarity with web applications & databases
• Good taste in product, particularly developer-oriented tools
• Interest in ML/AI infrastructure and willingness to learn

Tech stack

• Spark
• React
• Kubernetes
• Python
• Go