Senior ML Performance Engineer, Inference Optimisation

Job summary

Responsibilities

This is a hands-on role across ML systems, compilers, runtimes, kernels and embedded deployment. You'll find bottlenecks, implement performance improvements, and work with model developers on performance trade-offs so deployment-aware decisions are made early.

• Profiling inference performance across model graphs, compiler/runtime behaviour, kernel execution and memory movement
• Implementing and validating optimisations in compilers, runtimes and/or kernels, including fusion, scheduling, quantisation-aware performance and custom kernels
• Building benchmarking and regression tests to track performance across models, devices and software releases
• Optimising for edge targets such as NVIDIA Orin/Thor and Qualcomm platforms
• Contributing to team tooling, documentation and technical discussions around ML performance

Tech stack

• CUDA
• Triton
• Python
• C++