AI Quality Engineer

About this role

Monitor and improve the quality of Neon's AI automation agents that handle healthcare workflows by reviewing agent outputs, identifying errors, and providing actionable feedback to enhance performance. This role bridges quality assurance and product improvement in a fast-paced healthcare AI startup.

What you'll do

• Review AI agent call transcripts and recordings to assess performance quality
• Identify, label, and document issues encountered during agent interactions
• Analyze root causes of problems to understand why errors occurred
• Provide detailed improvement recommendations for agent refinement
• Scale quality reviews while maintaining high attention to detail
• Feed insights back to product and engineering teams for continuous improvement

What they're looking for

• Attention to detail
• Problem analysis and root cause investigation
• Quick execution and decision-making
• Technical system understanding
• Communication and documentation
• Critical thinking and rigor
• Adaptability in ambiguous environments
• Healthcare or insurance domain knowledge (preferred)

Benefits

• Mission-driven work improving patient access to life-saving medications
• Early-stage opportunity at a hypergrowth, profitable startup
• Work with experienced founding team and elite VC backing
• Opportunity to directly impact AI quality at scale
• Collaborative environment with experienced engineers