Arena Intelligence
Software Engineer, Platform
About this role
Arena Intelligence seeks an experienced backend engineer to build scalable, reliable infrastructure for AI model evaluation at the platform layer. You'll design APIs, handle complex streaming challenges across multiple LLM providers, and ship enterprise-grade systems as an early infrastructure team member in a fast-moving startup.
What you'll do
- Design and implement low-latency, high-reliability APIs for leaderboards, models, and evaluation arenas
- Solve streaming problems including SSE responses, partial failure recovery, mid-stream fallback, and response normalization across heterogeneous providers
- Build enterprise infrastructure including rate limiting, authentication, usage metering, cost attribution, audit logging, and SOC 2 compliance
- Implement deep observability with distributed tracing, latency breakdowns, token-level tracking, and real-time dashboards
- Integrate with the core evaluation platform and collaborate with researchers to turn novel ideas into products
- Contribute across the backend stack including leaderboards and evals platforms to unify public and private data architectures
What they're looking for
- Go (primary backend language)
- Distributed systems and infrastructure design
- LLM provider APIs (OpenAI, Anthropic, Google, etc.)
- API gateway and proxy design patterns
- Streaming and SSE handling
- Cloud infrastructure (AWS, GCP, or Azure)
- Postgres and Redis databases
- Kubernetes and infrastructure-as-code (Terraform)
Benefits
- Competitive salary and equity compensation
- Comprehensive medical, dental, and vision coverage
- Early-stage startup environment with meaningful impact on AI infrastructure
- Collaborative team of researchers and engineers from top institutions
- Hands-on individual contributor role with technical depth over management
- 3 days/week onsite in San Francisco
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Arena Intelligence
Arena Intelligence builds a platform for evaluating AI model performance through real-world testing and human preference data, powering insights for AI labs and enterprises. The company is hiring data engineers, security engineers, machine learning scientists, and customer-facing technical roles to scale its evaluation infrastructure, protect against misuse, and deliver custom solutions to customers.
View all jobs at Arena IntelligenceLikely interview questions
- Tell us about a time you built or significantly improved an API gateway or infrastructure service that handled high throughput and complex routing logic.
- How have you approached handling streaming responses from multiple external services with different failure modes and latency profiles?