Skip to main content

OpenAI

Software Engineer, AI accelerator Runtime

San Francisco (Remote)$266k–$445kfulltimemidAdded today

About this role

Design and implement low-level device runtime software for OpenAI's custom AI accelerator, managing kernel scheduling, memory, synchronization, and hardware-software interfaces. Work across compiler, kernel, and silicon teams using cycle-accurate simulation to validate behavior and optimize performance before and after silicon availability.

What you'll do

  • Design and implement low-level device runtime for custom AI accelerator silicon
  • Build kernel-launch scheduling, command submission, queueing, and dependency tracking systems
  • Manage device memory allocation, virtual-to-physical mappings, and data movement across concurrent workloads
  • Implement synchronization primitives, events, barriers, and ordering guarantees
  • Use event-based cycle-accurate simulators to develop, validate, and debug runtime behavior
  • Diagnose concurrency, memory-ordering, and performance issues across software-hardware boundaries

What they're looking for

  • Low-level systems programming (C, C++, Rust)
  • Runtime, driver, firmware, or OS kernel development
  • Concurrency and synchronization primitives
  • Memory management and hardware-software interfaces
  • Event-based cycle-accurate simulation
  • Performance analysis and quantitative reasoning
  • Cross-team debugging and systems integration
  • Hardware architecture understanding
Apply with Autofill

Opens the application — the Jobs AI extension fills it for you. Set up autofill

Opens the official application on the employer’s site. No login required.

OpenAI

OpenAI builds AI infrastructure and products, including large-scale data center campuses for AI computing and generative AI applications for enterprise customers. The company is hiring civil engineers, project engineers, electrical design engineers, data center R&D engineers, and AI deployment engineers to expand its infrastructure capabilities and help customers deploy AI solutions.

View all jobs at OpenAI

Likely interview questions

  • Describe your experience building runtimes or drivers for accelerators or specialized hardware—what were the key challenges you faced?
  • Walk us through how you've debugged a complex concurrency issue that spanned multiple software layers and hardware behavior.
Unlock all 7 questions free — and practice them live →