Software Engineer, Accelerators

About this role

Join OpenAI's Kernels team to optimize AI software for new accelerator platforms. You'll prototype system software, develop high-performance kernels, and enable large-scale model training and inference across diverse hardware environments.

What you'll do

• Prototype and enable OpenAI's AI software stack on new accelerator platforms
• Optimize large-scale AI model performance for diverse hardware environments
• Develop kernels, sharding mechanisms, and distributed scaling strategies for emerging accelerators
• Perform system-level performance modeling and debug bottlenecks across the stack
• Collaborate with hardware vendors to evaluate platforms and adapt software architectures
• Drive runtime improvements and compute/communication optimizations for frontier AI workloads

What they're looking for

• AI infrastructure and systems optimization
• Kernel development and accelerator platforms (TPUs, custom silicon)
• Distributed systems and sharding techniques
• Performance modeling and system debugging
• Model optimization (LLMs, CNNs, recommender systems)
• Hardware-software co-design
• Full-stack software optimization
• PyTorch and low-level ML framework experience