Sunset
AI Product Engineer
- Confirmed live in the last 24 hours
- No salary listed
- Mid level
- Full-time
- On-site · New York
- Added 1 month ago
About this role
Replay is seeking a Senior AI Product Engineer to build and operate a trustworthy AI-powered dissolution support product, transforming their initial support agent into a reliable solution. This role involves owning the entire product lifecycle, from customer problem definition to production behavior and iteration, with a focus on correctness, customer trust, and maintainable systems. You'll partner closely with product, support, and engineering teams to deliver a robust and secure product.
What you'll do
- Own AI-assisted dissolution support from problem definition to production.
- Design retrieval, context, and structured outputs for grounded behavior.
- Build clear user experiences for both supported and unsupported scenarios.
- Create evaluations for routing, grounding, safety, and customer outcomes.
- Implement permissions, privacy controls, and auditability.
- Instrument and analyze runtime and tool reliability.
What they're looking for
- LLM-backed software
- Product Engineering
- Retrieval & Context Selection
- Tool Use & Orchestration
- Evaluation & Observability
- Python
- TypeScript
- React
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Sunset
Likely interview questions
- Describe a time you had to balance accuracy and customer experience in a production system.
- How would you approach designing a system to handle unsupported claims or uncertain data in an AI application?