Backend Engineer, AI (Agent Systems)

About this role

A1 seeks a Backend Engineer to design and operate the inference and orchestration systems powering their AI assistant product. You'll build production-grade APIs that handle multi-step reasoning, external tool integration, and real-world task completion while optimizing for latency, reliability, and cost.

What you'll do

• Build and operate backend systems serving AI features in production environments
• Design inference pipelines, orchestration layers, and service boundaries around LLM models
• Own production monitoring, logging, alerting, and incident response
• Optimize latency and throughput through caching, batching, and streaming strategies
• Integrate with multiple LLM providers and manage model deployment
• Debug and resolve issues in distributed systems under production load

What they're looking for

• Backend engineering and production systems experience
• High-throughput, low-latency service design
• AI inference patterns (LLMs, embeddings, multimodal models)
• Python and/or Node.js
• Kubernetes and Docker containerization
• SQL and NoSQL databases
• Distributed systems debugging
• API design and integration