Skip to main content

Meridial

AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer Project

World Wide - Remote (Remote)$145.6k–$208kcontractmidAdded today

About this role

Audit and evaluate AI training tasks for developer workflows, ensuring technical accuracy, feasibility, and quality of testing criteria. Provide detailed feedback on IDE integrations, AI-assisted coding implementations, and logic issues to improve AI system training datasets.

What you'll do

  • Assess developer workflow tasks for technical accuracy, realism, and reproducibility
  • Evaluate whether tasks are solvable with reliable test and evaluation criteria
  • Identify IDE integration faults and AI-assisted coding inefficiencies
  • Detect logic errors and technical inconsistencies within assigned tasks
  • Provide clear, actionable feedback and recommendations for improvement
  • Ensure training workflows meet rigorous professional standards

What they're looking for

  • AI coding assistants and IDE integrations
  • Developer tooling and workflow ecosystems
  • Telemetry and trace analysis
  • Technical problem-solving and debugging
  • Code review and quality assurance
  • Test design and evaluation criteria
  • Strong analytical thinking
  • Clear technical communication

Benefits

  • Flexible remote work arrangement
  • Hourly contract compensation
  • Work on cutting-edge AI and developer tools
  • Opportunity to specialize in your domain
  • Freelance flexibility
Apply with Autofill

Opens the application — the Jobs AI extension fills it for you. Set up autofill

Opens the official application on the employer’s site. No login required.

Meridial

Meridial trains and improves advanced AI models through expert evaluation and feedback across infrastructure, software engineering, machine learning, and language domains. The company hires experienced freelance specialists—including software engineers, ML experts, and language specialists—to test AI reasoning, identify failure modes, and provide detailed training data to enhance model capabilities.

View all jobs at Meridial

Likely interview questions

  • Walk us through your experience with AI coding assistants and how you've evaluated their effectiveness in practice.
  • Describe a time when you identified a critical flaw in a developer workflow or tool—how did you diagnose and communicate it?
Unlock all 7 questions free — and practice them live →