Sable
Applied AI Engineer, Evals
- Confirmed live in the last 24 hours
- No salary listed
- Mid level
- Full-time
- On-site · San Francisco
- Added 3 weeks ago
About this role
Sable is seeking an Applied AI Engineer to focus on evaluating and improving their AI employee, Aidan. This role involves designing and executing evaluations across voice, vision, and browser use, ultimately refining the agent's performance and its underlying models. You'll contribute to creating benchmarks and simulations to identify areas for enhancement.
What you'll do
- Design evaluations for voice, vision, and browser use.
- Build and maintain internal benchmarks and simulations.
- Score customer-specific scenarios.
- Identify gaps in current agent capabilities.
What they're looking for
- Machine Learning
- Statistics
- Evaluation
- Voice AI
- Computer Vision
- Browser Use
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Sable
Likely interview questions
- Describe your experience designing evaluation frameworks for AI agents.
- How would you approach creating a benchmark for a voice-based AI agent?