Otter.ai
Software Engineer, AI Agent & LLM
- Confirmed live in the last 24 hours
- $155k–$185k
- Mid level
- On-site · Mountain View, CA
- 3+ yrs exp
- Added 2 months ago
About this role
Otter.ai is seeking a Senior AI Agent & LLM Engineer to build and enhance their conversational knowledge engine and AI Chat. This hands-on role involves developing AI-agent experiences, improving knowledge extraction, establishing quality evaluation systems, and resolving failures across various components. The ideal candidate will combine strong software engineering skills with a focus on AI quality and a proven ability to take ambiguous problems to production.
What you'll do
- Build AI-agent experiences for Otter AI Chat.
- Improve knowledge extraction, annotation, and indexing for the knowledge engine.
- Develop evaluation datasets and automated grading systems.
- Diagnose failures across models, prompts, and data pipelines.
- Build shared agent infrastructure for orchestration and observability.
- Improve task completion, correctness, and reliability.
What they're looking for
- AI Agent Engineering
- LLM
- Machine Learning Engineering
- Backend Engineering
- Distributed Systems
- AI Quality Evaluation
- Debugging
Opens the official application on the employer’s site. No login required.
Otter.ai
Likely interview questions
- Describe your experience building and shipping AI-agent or LLM-powered products.
- How do you approach evaluating the quality of non-deterministic AI systems?