Software Engineer - GPU Kernels

Job summary

Responsibilities

We’re seeking a GPU Kernel Engineer to join our team at the cutting edge of AI acceleration, where your code directly impacts the performance of state-of-the-art machine learning models.

• Design and implement high-performance GPU kernels for key ML operations, including matrix multiplications, attention mechanisms, and mixture-of-experts routing
• Write and optimize code using CUDA, PTX assembly, and architecture-specific techniques
• Apply advanced performance optimization methods such as memory coalescing, warp-level programming, tensor core acceleration, and compute/memory overlap

What they're looking for

• Strong understanding of GPU architecture and programming paradigms:
• Memory hierarchy (global, shared, registers, L1/L2 cache)
• Thread/block/grid organization
• Synchronization techniques and race condition mitigation
• Proficient in C++ and GPU performance profiling tools

Tech stack

• Spark
• CUDA
• AWS
• C++
• Triton