Senior Principal Model Bring-up Engineer

Job summary

Responsibilities

You will bring new open-weight LLMs, including dense, mixture-of-experts, and hybrid Mamba/attention architectures, up on SambaNova’s RDU dataflow accelerators and into production serving.

• Bring up new LLM architectures end to end: model adaptation, checkpoint conversion, multi-chip / multi-host mapping, compile, strict numerical validation, production serving with…
• Build inference features once as shared modules: continuous batching over a paged KV pool, prompt caching, chunked and incremental prefill, dynamic tensor shapes, speculative…
• Debug where model, compiler and hardware meet; land each fix in the right shared component.

What they're looking for

• B.S. in Computer Science, Electrical Engineering, or related field
• 8+ years of industry experience in ML systems, inference, or compiler engineering
• Strong Python and PyTorch internals experience, plus some C++
• Deep transformer-inference knowledge, including KV caching, GQA and sliding window attention, MoE routing, prefill vs decode, batching, and speculative decoding
• Hands-on experience with accelerator bring-up, ML compilers (MLIR, XLA, TVM, Triton, torch-mlir), or inference engines (vLLM, SGLang, TensorRT-LLM)

Tech stack

• Python
• PyTorch
• C++
• Triton
• vLLM