Backend Engineer, AI (Agent Systems)

About this role

A1 is seeking a Backend Engineer to build and operate the inference and orchestration systems powering their AI assistant product. You'll own the critical layer between AI models and users, focusing on reliability, latency, and cost optimization for multi-step reasoning and real-world task completion.

What you'll do

• Design and operate production inference pipelines and orchestration layers
• Build stable, observable APIs serving AI features across mobile and desktop clients
• Implement production monitoring, logging, alerting, and incident response systems
• Optimize latency and throughput through caching, batching, and streaming strategies
• Debug and resolve issues in distributed systems under load
• Collaborate with ML and frontend systems to ensure seamless integration

What they're looking for

• Backend engineering in production environments
• High-throughput, low-latency service design
• AI inference patterns (LLMs, embeddings, multimodal)
• Python and/or Node.js
• Kubernetes and Docker containerization
• SQL and NoSQL databases
• Distributed systems debugging
• Production observability and incident response