Staff Software Engineer, Cortex AI Search Infrastructure

Job summary

Responsibilities

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work.

• Architect Agentic Runtimes: Build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.
• Scale Context Engineering Infra: Design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable and efficient search…
• Build the "Evals Engine": Develop the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and "hillclimbing" experiments.
• Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened, multi-tenant microservices with strict guardrails and…
• Optimize Performance & Cost: Direct the infra strategy for model routing, prompt caching, and token optimization to ensure Snowflake’s AI features are the most efficient in the…

What they're looking for

• Education: Bachelor’s degree in Computer Science or a related technical field.
• Experience: 9 + years of experience building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
• Technical Stack: Deep proficiency in Go or Java (for systems) and Python (for AI orchestration).
• Systems Thinking: Strong understanding of database internals, distributed state management, and cloud-native architecture (Kubernetes, FoundationDB, etc.).
• Domain Expertise: Familiarity with the "plumbing" of AI: vector indices, agent platforms, and building scalable data pipelines.

Tech stack

• RAG
• Go
• Java
• Python
• Kubernetes
• SQL
• Snowflake