Tokens-as-a-Service (Taas) Software Engineer

About this role

OpenAI is hiring a TaaS Software Engineer to build systems that measure and optimize token throughput across GPU compute infrastructure. You'll develop tooling for performance monitoring, infrastructure integration, and operational analytics to convert raw compute capacity into productive AI workload capacity.

What you'll do

• Develop monitoring and measurement systems for token throughput across first-party and partner compute environments
• Support performance benchmarking, tokenomics analysis, and model porting across heterogeneous infrastructure
• Build integration tooling to connect external partner infrastructure into OpenAI's internal systems
• Track operational metrics including billing, usage, SLAs, utilization, and reliability
• Identify bottlenecks across hardware, networking, software, and workload layers
• Create dashboards and automation for visibility into capacity, performance, and business outcomes

What they're looking for

• Systems and infrastructure software engineering
• Distributed systems and performance engineering
• GPU cluster and AI infrastructure knowledge
• Monitoring and observability systems
• Token throughput and workload optimization
• Debugging across hardware, networking, and software domains
• Infrastructure integration and platform engineering
• Data analysis and reporting