Software Engineer, Machine Learning Infrastructure - Generative AI

About this role

Join DoorDash's GenAI Platform team to build shared infrastructure enabling safe, scalable generative AI products across DoorDash, Wolt, and Deliveroo. You'll design and maintain production systems including LLM gateways, agent orchestration, model serving, and evaluation infrastructure that accelerate AI-powered features from prototype to production.

What you'll do

• Design and build scalable GenAI platform surfaces including LLM Gateway, Agent Gateway, and model serving infrastructure
• Develop evaluation systems, batch inference pipelines, and guardrails for production AI agents and automation
• Partner with ML engineers and product teams to convert emerging GenAI capabilities into reusable platform primitives
• Ensure production systems meet latency, scale, monitoring, and SLO requirements with strong operational excellence
• Support rapid experimentation while maintaining reliability, observability, cost controls, and vendor abstraction
• Enable product teams to choose optimal model and vendor strategies across closed-source and open-weight options

What they're looking for

• Backend engineering fundamentals, particularly Python and distributed systems
• Production service development, APIs, data pipelines, and ML infrastructure at scale
• Systems observability, debugging, reliability, incident response, and performance/cost optimization
• Machine learning workflows including inference, evaluation, model serving, and experimentation
• Ability to navigate ambiguous, fast-moving technical areas and abstract use cases into platform capabilities
• Experience with Kubernetes, cloud infrastructure (AWS/GCP), GPUs, or batch processing systems
• LLM infrastructure knowledge such as gateways, model routing, cost attribution, or evals
• AI agent deployment, RAG/retrieval pipelines, or LLM observability and tracing

Benefits

• 401(k) plan with employer matching
• Comprehensive benefits package for regular employees
• Equity grant opportunities
• Work on high-impact GenAI infrastructure shaping DoorDash's AI future
• Collaboration with teams across three global companies (DoorDash, Wolt, Deliveroo)