Hardware / Software CoDesign Engineer - 3P

Job summary

Responsibilities

As an Engineer on our hardware optimization and co-design team, you will co-design future hardware from different vendors for programmability and performance. You will work with our kernel, compiler and machine learning engineers to understand their unique needs related to ML techniques…

• Co-design future hardware for programmability and performance with our hardware vendors
• Assist hardware vendors in developing optimal kernels and add support for it in our compiler
• Develop performance estimates for critical kernels for different hardware configurations and drive decisions on compute core and memory hierarchy features
• Build system performance models at different abstraction levels and carry out analysis to drive decisions on scale up, scale out, front end networking
• Work with machine learning engineers, kernel engineers and compiler developers to understand their vision and needs from high performance accelerators

What they're looking for

• 4+ years of industry experience, including experience harnessing compute at scale and optimizing ML platform code to run efficiently on target hardware.
• Strong experience in software/hardware co-design
• Deep understanding of GPU and/or other AI accelerators
• Experience with CUDA, Triton or a related accelerator programming language
• Experience driving Machine Learning accuracy with low precision formats

Tech stack

• CUDA
• Triton
• C++
• Python