OpenAI
Software Engineer, Search Infrastructure
About this role
Design and operate the infrastructure systems that integrate search and model inference across ChatGPT at scale. You'll own end-to-end projects spanning search orchestration, latency optimization, experimentation frameworks, and production reliability while partnering with research and engineering teams.
What you'll do
- Design and evolve services coordinating search classification, retrieval, ranking, and model inference in production
- Optimize end-to-end latency, throughput, and infrastructure efficiency through profiling, caching, and capacity planning
- Build experimentation tooling and automation for A/B testing, metrics definition, and safe production rollouts
- Ensure production reliability through observability, resilience, incident response, and operational automation
- Develop search APIs and tool interfaces for models and agents with access controls and source attribution
- Partner with researchers and teams to translate product and research needs into technical designs and measurable results
What they're looking for
- Distributed systems design and operation at scale
- Performance optimization and systems debugging
- Search, information retrieval, or ML infrastructure experience
- High-throughput online systems
- Programming across multiple languages
- Experimentation design and A/B testing
- Production observability and reliability engineering
- Cross-team collaboration and technical communication
Benefits
- Hybrid work model (3 days in office per week)
- San Francisco-based role
- Relocation assistance available
- Work on AI systems impacting millions of users
- Collaborate with world-class researchers and engineers
- Access to cutting-edge ML infrastructure
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
OpenAI
OpenAI builds AI infrastructure and products, including large-scale data center campuses for AI computing and generative AI applications for enterprise customers. The company is hiring civil engineers, project engineers, electrical design engineers, data center R&D engineers, and AI deployment engineers to expand its infrastructure capabilities and help customers deploy AI solutions.
View all jobs at OpenAILikely interview questions
- Describe a time you optimized latency or throughput in a large-scale distributed system—what tradeoffs did you make?
- How have you approached designing a new service that needed to integrate with multiple teams' infrastructure?