OpenAI
Tokens-as-a-Service (Taas) Software Engineer
About this role
OpenAI is hiring a TaaS Software Engineer to build systems that measure and optimize token throughput across GPU compute infrastructure. You'll develop tooling for performance monitoring, infrastructure integration, and operational analytics to convert raw compute capacity into productive AI workload capacity.
What you'll do
- Develop monitoring and measurement systems for token throughput across first-party and partner compute environments
- Support performance benchmarking, tokenomics analysis, and model porting across heterogeneous infrastructure
- Build integration tooling to connect external partner infrastructure into OpenAI's internal systems
- Track operational metrics including billing, usage, SLAs, utilization, and reliability
- Identify bottlenecks across hardware, networking, software, and workload layers
- Create dashboards and automation for visibility into capacity, performance, and business outcomes
What they're looking for
- Systems and infrastructure software engineering
- Distributed systems and performance engineering
- GPU cluster and AI infrastructure knowledge
- Monitoring and observability systems
- Token throughput and workload optimization
- Debugging across hardware, networking, and software domains
- Infrastructure integration and platform engineering
- Data analysis and reporting
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
OpenAI
OpenAI builds AI infrastructure and products, including large-scale data center campuses for AI computing and generative AI applications for enterprise customers. The company is hiring civil engineers, project engineers, electrical design engineers, data center R&D engineers, and AI deployment engineers to expand its infrastructure capabilities and help customers deploy AI solutions.
View all jobs at OpenAI