Forward Deployed Engineer, Strategic Inference

Job summary

Responsibilities

As a Forward Deployed Engineer (FDE) focused on Inference, you will be a hands-on technical partner to our most strategic customers — production AI teams looking to leverage high quality models and do inference at scale.

• Inference Engine Optimization: Select, configure, and optimize inference engine based on hardware, model architecture, and workload profile
• Configuration & Performance Tuning: Develop configuration updates to win critical POCs, benchmarks, and optimize customer deployments; tune KV cache, apply speculative decoding…
• Strategic Customer Alignment: Act as the primary technical point of contact for aligned strategic accounts — monitoring and optimizing endpoint configurations, helping customers…
• Opinionated Onboarding: Establish direct alignment with strategic customers at onboarding; ensure the right inference configurations are in place from day one to improve…
• Product Feedback Loop: Directly influence our software and model roadmap by surfacing insights from the field.

What they're looking for

• Experience: 5+ years in a technical role, with a strong focus on system optimization. Recent experience in inference systems and open-source LLM deployments.
• Inference Engine Depth: Expert-level, hands-on experience with inference engines (e.g., vLLM, TensorRT-LLM, SGLang); ability to diagnose and resolve performance issues at the…
• Inference Optimization: Deep knowledge of KV cache tuning, speculative decoding, tensor parallelism, pipeline parallelism, and quantization techniques
• Model Landscape Awareness: Broad knowledge of state-of-the-art open-source models and strong judgment on model selection for specific customer use cases, hardware profiles, and…
• Coding Proficiency: Strong Python skills; comfortable working in production environments

Tech stack

• vLLM
• Python