Agent Experience Engineer

About this role

AgentMail seeks an Agent Experience Engineer to optimize how AI models and agents discover and integrate with their identity platform. You'll own answer-engine optimization, build evals and benchmarks for frontier and open-source models, analyze agent traces against documentation, and shape the agent-facing surface including llms.txt and MCP descriptions.

What you'll do

• Measure and improve AgentMail's presence in LLM answers for email and agent identity queries
• Design and run evals, benchmarks, and agent trace analyses to measure product usability across different models
• Debug agent confusion by reviewing traces against docs and fixing documentation or error messages that cause failures
• Own agent-facing surfaces including llms.txt, MCP descriptions, documentation structure, and error messaging
• Manage and verify the automated content pipeline, coordinate with freelancers, and conduct backlink outreach
• Maintain weekly AEO briefings tracking freshness, competitors, and action items

What they're looking for

• Agent development and daily hands-on experience building with LLMs or agent frameworks
• Understanding of retrieval systems and how models consume chunked vs. paginated content
• Technical benchmarking and evaluation design
• Cross-functional collaboration and stakeholder communication
• Technical writing and documentation
• Answer engine optimization (AEO) or SEO fundamentals
• Ability to analyze and interpret agent traces and reasoning logs
• MCP server development or protocol familiarity

Benefits

• Early-stage equity opportunity (0.2% to 0.5%)
• Work directly with frontier AI model developers and agent builders
• Influence product direction through research and data
• San Francisco location with team of investors including Y Combinator, General Catalyst, and founder-investors