People Culture Talent
Software Engineer, Platform
About this role
Join a founding engineering team building an AI gateway platform that unifies access to multiple model providers. You'll develop backend infrastructure for an AI evaluation platform used by leading labs, focusing on reliable service scaling, streaming solutions, and observability.
What you'll do
- Build and scale backend platform services for an AI gateway, evolving prototypes into production-grade, independently scalable systems
- Solve complex streaming challenges including SSE responses, partial failure recovery, mid-stream fallbacks, and response normalization across heterogeneous providers
- Develop platform infrastructure for authentication, rate limiting, usage metering, and cost tracking
- Implement distributed tracing, latency analysis, usage tracking, and real-time observability dashboards
- Integrate with evaluation platforms and collaborate with research teams to build AI-centered platform capabilities
- Contribute across the stack to leaderboards and evaluation products when needed
What they're looking for
- Go/Golang (required, production systems)
- Backend services and distributed systems design
- API and gateway/proxy architecture
- Streaming APIs and resilient systems
- Cloud platforms (GCP, AWS, or Azure)
- Infrastructure tools (Kubernetes, Terraform, Postgres, Redis)
- Observability and monitoring systems
- LLM APIs and AI infrastructure (nice to have)
Benefits
- Comprehensive health, dental, and vision coverage
- Equity participation
- Work on cutting-edge AI technology
- Small, mission-driven team environment
- Culture emphasizing transparency and trust
- Visa sponsorship available
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
People Culture Talent
People Culture Talent builds a platform for sophisticated software and AI teams, offering AI infrastructure and developer-focused tools. The company is hiring Developer Relations, Frontend Engineers, Product Engineers, Customer Engineers, and Sales Engineers to strengthen community engagement, enhance user experience, and support technical implementation and sales efforts.
View all jobs at People Culture TalentLikely interview questions
- Describe your experience building and operating backend systems in production—what scaling challenges have you solved?
- Walk us through a complex API integration or gateway project you've owned. How did you handle failures and edge cases?