Montecarlodata
Applied AI Engineer
- Confirmed live in the last 24 hours
- $200k–$260k
- Mid level
- Full-time
- Remote, Americas
- 3+ yrs exp
- Added 1 month ago
About this role
Monte Carlo is seeking an Applied AI Engineer to build and maintain the platform that ensures the trustworthiness of AI agents. This role involves taking open problems from research through production, designing and implementing agent-powered features, and establishing technical standards for LLM development. The ideal candidate will have hands-on experience building and monitoring agents in production, working end-to-end and prioritizing rapid iteration over perfection.
What you'll do
- Researching and prototyping solutions to ambiguous problems.
- Designing and shipping agent-powered features like root-cause analysis and incident triage.
- Building evaluation infrastructure for agent safety and reliability.
- Owning retrieval and context pipelines for agent metadata.
- Collaborating with data science and product management teams.
- Defining technical patterns and guardrails for LLM usage.
What they're looking for
- Python
- ML/Data Science
- LLMs
- Data Pipelines
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Montecarlodata
- Industry
- Technology & Software
Likely interview questions
- Describe your experience building and deploying autonomous AI agents in a production environment.
- How have you approached evaluating and monitoring the performance of agents after launch, particularly when dealing with non-deterministic behavior?