AI Engineer, Evaluation

About this role

Mixpanel is seeking a Senior Software Engineer for its AI Platform team to build and enhance scalable infrastructure that empowers AI development. The role involves designing backend services and frameworks that support AI agents, ensuring their reliability and performance.

What you'll do

• Design core backend services and APIs for AI models
• Build frameworks for multi-step agent workflows
• Develop evaluation systems for AI reasoning and task success
• Ensure high-performance serving infrastructure
• Implement comprehensive monitoring and observability
• Mentor junior engineers and advocate for best practices

What they're looking for

• Bachelor's degree in Computer Science or related field
• 5+ years of software engineering experience
• Strong full-stack development skills
• Technical communication proficiency
• Experience with LLMs and AI systems
• Debugging and technical investigation skills
• Ability to work in fast-paced environments
• Familiarity with AI agent optimization techniques

Benefits

• Competitive salary ranging from $174,600 to $213,400
• Eligibility for equity consideration
• Flexible hybrid work environment
• Comprehensive health benefits
• Opportunities for professional development
• [Unknown]