Arena Intelligence
Site Reliability Engineer
About this role
Arena Intelligence seeks a Site Reliability Engineer to build and maintain the core infrastructure powering their AI model evaluation platform. You'll design scalable APIs, implement enterprise-grade systems, and ensure reliable operation of high-throughput services handling requests across multiple frontier AI models.
What you'll do
- Design and implement low-latency, high-reliability APIs for leaderboards, models, and evaluation arenas
- Build enterprise infrastructure including rate limiting, authentication, usage metering, and SOC 2 compliance
- Instrument systems with distributed tracing, latency analysis, and real-time observability dashboards
- Integrate evaluation platform with customer benchmarks and collaborate with research team on novel products
- Handle bursty, unpredictable load and implement graceful failure handling for upstream model providers
- Architect multi-tenant, AI-focused infrastructure that abstracts operational complexity from users
What they're looking for
- Go and/or Rust for high-throughput systems
- Distributed systems and infrastructure design
- AWS or GCP cloud platforms, Kubernetes, and Terraform
- Postgres, Redis, and database systems
- LLM provider APIs (OpenAI, Anthropic, Google) and token/streaming management
- API gateway or proxy architecture
- Observability and monitoring (distributed tracing, metrics)
- Product-oriented thinking and developer experience design
Benefits
- Competitive compensation and equity aligned to location
- Comprehensive health and wellness benefits
- Early-stage startup environment with significant ownership and impact
- Collaboration with researchers from UC Berkeley, Google, Stanford, and DeepMind
- Work on foundational AI infrastructure at the frontier
Opens the official application on the employer’s site. No login required.
Arena Intelligence
Arena Intelligence builds a platform for evaluating AI model performance through real-world testing and human preference data, powering insights for AI labs and enterprises. The company is hiring data engineers, security engineers, machine learning scientists, and customer-facing technical roles to scale its evaluation infrastructure, protect against misuse, and deliver custom solutions to customers.
View all jobs at Arena IntelligenceLikely interview questions
- Walk us through a high-throughput API system you've built—what were the bottlenecks and how did you resolve them?
- Describe your experience handling bursty or unpredictable traffic patterns. What strategies did you use?