Software Engineer, Search Infrastructure

Job summary

Responsibilities

As a senior engineer on the Search Product Infrastructure team, you will design, build, and operate the systems that connect models with search at ChatGPT scale. You will tackle challenges in search orchestration, inference efficiency, experimentation, and production reliability, making tradeoffs…

• Design and evolve the services that coordinate search classification, retrieval, ranking, and model inference, working closely with researchers and partner engineering teams to…
• Improve end-to-end latency, throughput, and infrastructure efficiency through profiling, caching, request routing, and capacity planning, making informed tradeoffs between search…
• Build experimentation tooling and automation to run reproducible A/B tests, define success metrics, and measure product impact.
• Own production reliability through observability, resilient fallback behavior, incident response, and automation that improves launch safety and reduces operational toil.
• Build search APIs and tool interfaces that enable models and agents to retrieve information reliably while respecting access controls and preserving source attribution.