Software Engineer, Collective Communication

Job summary

Responsibilities

As a Software Engineer, Networking you will design and implement custom networking collectives that are tightly integrated into our training stack.

• Collaborate closely with ML researchers to design and implement efficient collective operations in C++ and CUDA.
• Ensure that our largest training jobs take full advantage of the different network transports used in our supercomputers.
• Work on simulations to inform our future supercomputer network designs.
• Have written distributed algorithms using RDMA in the past.
• Are comfortable writing low level performance sensitive CPU and/or GPU code.

Tech stack

• C++
• CUDA