Console
Research Engineer
About this role
Console is seeking a Research Engineer to optimize its AI agents that automate enterprise operations. You'll build evaluation and optimization systems that turn production data into measurable improvements in agent reasoning, reliability, and cost, working across evals, fine-tuning, prompt optimization, and model adaptation.
What you'll do
- Build eval and optimization loops that measure and improve agent quality, latency, and reliability using production data
- Systematically improve agent behavior through prompt engineering, program optimization, routing logic, and model adaptation techniques
- Fine-tune and evaluate specialist models for high-volume, repeatable tasks with clear production feedback signals
- Develop tracing, eval infrastructure, and offline replay systems for agent debugging and continuous improvement
- Work across the full stack from infrastructure to product workflows to optimize real-world agent performance
- Partner with product, engineering, and leadership to ship improvements into production quickly
What they're looking for
- Software engineering fundamentals and system design
- Machine learning and applied AI (production systems experience)
- Evaluation frameworks for AI systems (datasets, judges, metrics, regression testing)
- Model adaptation and post-training methods (LoRA, SFT, DPO, GRPO, reward modeling)
- Prompt optimization and agentic system design
- Python and ML infrastructure tools
- Ownership mindset and ability to ship end-to-end projects
- Familiarity with SOTA research in agents, evals, and optimization
Benefits
- Competitive compensation
- Full benefits package
- Product-market fit in massive market
- World-class team of high-agency contributors
- Growth opportunities from within as company scales
- Impact-based rewards
Opens the official application on the employer’s site. No login required.
Console
Console builds an AI agent platform that automates enterprise operations across IT, HR, Finance, and other functions by turning AI capabilities into actionable workflows. The company is hiring Infrastructure Engineers, Platform Engineers, Product Engineers, Applied AI Engineers, and Forward Deployed Engineers to develop scalable cloud infrastructure, optimize intelligent agent systems, and lead enterprise customer implementations.
View all jobs at ConsoleLikely interview questions
- Walk us through a production AI system you've built—what were the key evaluation challenges and how did you measure success?
- Tell us about a time you optimized model performance through fine-tuning or prompt engineering. What metrics drove your decisions?