Software Engineer, Accelerators

Job summary

Responsibilities

On the Accelerators team, you will help OpenAI evaluate and bring up new compute platforms that can support large-scale AI training and inference.

• Prototype and enable OpenAI's AI software stack on new, exploratory accelerator platforms.
• Optimize large-scale model performance (LLMs, recommender systems, distributed AI workloads) for diverse hardware environments.
• Develop kernels, sharding mechanisms, and system scaling strategies tailored to emerging accelerators.
• Collaborate on optimizations at the model code level (e.g. PyTorch) and below to enhance performance on non-traditional hardware.
• Work with hardware teams and vendors to evaluate alternatives to existing platforms and adapt the software stack to their architectures.

What they're looking for

• 3+ years of experience working on AI infrastructure, including kernels, systems, or hardware-software co-design
• Hands-on experience with accelerator platforms for AI at data center scale (e.g., TPUs, custom silicon, exploratory architectures).
• Strong understanding of kernels, sharding, runtime systems, or distributed scaling techniques.
• Familiarity with optimizing LLMs, CNNs, or recommender models for hardware efficiency.
• Experience with performance modeling, system debugging, and software stack adaptation for novel architectures.

Tech stack

• PyTorch