AI Performance Engineer - New Grad

Job summary

Responsibilities

As a new grad AI Performance Engineer, you'll bring up new open source models on the SambaNova stack and work to make them run faster. You'll profile model execution, find bottlenecks, and apply optimizations such as quantization, kernel fusion, and improved scheduling with the compiler, runtime…

• Bring up new foundation models on the SambaNova platform using our software stack
• Profile model performance across the compiler, runtime, and hardware layers
• Identify bottlenecks and propose dataflow or scheduling optimizations for single-node and distributed systems
• Apply techniques from recent research in quantization, scheduling, and memory optimization
• Benchmark throughput and latency and track performance changes across releases

What they're looking for

• B.S. in Computer Science, Electrical Engineering, or related field
• Strong programming skills in Python or C++
• Understanding of algorithms, data structures, and numerical computing
• Experience with PyTorch, TensorFlow, or JAX
• Experience with inference frameworks such as vLLM, TensorRT, or SGLang

Tech stack

• Python
• C++
• PyTorch
• TensorFlow
• JAX
• vLLM
• CUDA
• Triton