Infrastructure Software Engineer, Enterprise GenAI

Job summary

Responsibilities

Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our core infrastructure in a fast-paced environment.

• Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers
• Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
• Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs.
• Deliver experiments at a high velocity and level of quality to engage our customers
• Work across the entire product lifecycle from conceptualization through production

What they're looking for

• 4+ years of full-time engineering experience, post-graduation
• Experience scaling products at hyper growth startups
• Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies
• Proficient in Python or Javascript/Typescript, and SQL
• Experience with Kubernetes

Tech stack

• GCP
• Azure
• AWS
• Python
• TypeScript
• SQL
• Kubernetes