AI Test Engineer (F/M/*)

About this role

Join a rapidly growing European AI startup as a Test Engineer to develop and execute comprehensive testing strategies for AI applications, agents, and workflows. You'll ensure quality throughout the development lifecycle by validating AI behavior, automating tests, and collaborating with product and engineering teams.

What you'll do

• Design and optimize test strategies for AI applications with focus on quality assurance from the start
• Conduct manual and automated testing for AI features, APIs, and workflows
• Validate AI responses, prompts, model behavior, and agent logic for quality and robustness
• Identify, document, and track bugs, edge cases, and quality risks systematically
• Create test cases, test data, and evaluation criteria for various use cases
• Build QA processes, drive test automation, and establish reliable release checks

What they're looking for

• Software testing and QA methodology
• Test automation and QA tools
• API and web application testing
• LLMs, AI systems, and prompt engineering knowledge
• Test case design and systematic error analysis
• Technical understanding of interfaces and data flows
• German and English language proficiency
• Structured, analytical problem-solving approach

Benefits

• Team offsites twice yearly across Europe
• Choice of subsidized Germany rail ticket or Urban Sports Club membership
• Hybrid work model with 3 days per week on-site
• Daily meal vouchers at office locations
• Competitive compensation with equity participation
• Professional development and learning opportunities