OpenAI
Systems Generalist, GPT Infrastructure
About this role
OpenAI seeks an experienced systems generalist to design and build an automated inference optimization platform that runs optimization campaigns across diverse hardware accelerators. You'll architect both OpenAI-hosted control planes and partner-side evaluation software, bridging research prototypes into reliable, scalable production systems that maintain security and reproducibility at global scale.
What you'll do
- Design and operate durable APIs and control-plane services for multi-hour optimization campaigns with scheduling, retries, checkpoints, and observability
- Build secure partner-side runner and grader software to compile, execute, verify, and benchmark candidate artifacts on third-party accelerator hardware
- Integrate hardware profiles, compilers, runtimes, and inference engines into repeatable optimization workflows
- Develop correctness and performance evaluation systems spanning latency, throughput, memory, utilization, and cost efficiency
- Create artifact, provenance, and qualification workflows that enable safe review and deployment of optimized kernels and configurations
- Lead cross-functional technical initiatives connecting OpenAI infrastructure with strategic partner environments
What they're looking for
- Distributed systems design and operation
- C++, Python, Go, or Rust programming
- Highly available backend systems and job orchestration
- Linux, networking, storage, containers, and cloud architectures
- Systems debugging, profiling, and benchmarking
- AI inference systems and machine learning infrastructure
- Compilers, runtimes, and performance engineering (LLVM, MLIR, CUDA, ROCm)
- GPU and accelerator hardware architecture knowledge
Opens the official application on the employer’s site. No login required.
OpenAI
OpenAI builds AI infrastructure and products, including large-scale data center campuses for AI computing and generative AI applications for enterprise customers. The company is hiring civil engineers, project engineers, electrical design engineers, data center R&D engineers, and AI deployment engineers to expand its infrastructure capabilities and help customers deploy AI solutions.
View all jobs at OpenAILikely interview questions
- Describe your experience building or operating large-scale distributed systems—what were the most critical reliability challenges and how did you address them?
- Tell us about a time you debugged a complex performance issue across multiple layers of a system; what tools and methodology did you use?