AI-Driven Developer Workflow Auditor — Freelance, Remote

Jobgether; United Arab Emirates; On-site; AED 354,000 - 506,000; Full time

Benefits offered by this job

Fully remote

Freelance contract

Job summary

Partner Company in the United Arab Emirates is seeking an AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer. This remote contract role requires auditing AI-assisted developer tasks to ensure they are realistic, reproducible, and properly evaluated.

You will provide precise feedback on tooling, IDE integrations, telemetry analysis, and AI-assisted coding workflows to improve AI training tasks and evaluation criteria.

Qualifications

• Demonstrable professional experience in modern developer tooling and AI-assisted development workflows.
• Familiarity with AI coding assistants, telemetry analysis, IDE integrations, and developer workflow ecosystems.
• Strong analytical and problem-solving abilities to test, troubleshoot, and assess complex technical scenarios.
• Ability to communicate findings clearly through concise, actionable feedback.
• Ability to work independently in a remote freelance environment.
• Access to a secure computer and reliable internet connection.

Responsibilities

• Evaluate developer workflow tasks for technical accuracy, realism, solvability, reproducibility, and proper criteria.
• Audit AI-assisted development scenarios to identify inconsistencies, logic errors, and workflow inefficiencies.
• Assess IDE integrations, tooling, telemetry and trace analysis, and AI-assisted coding workflows.
• Test and troubleshoot complex technical scenarios to ensure tasks function as intended and reproducible.
• Provide clear, detailed, and actionable feedback to improve AI training tasks.
• Apply professional judgment to ensure audited workflows reflect real-world environments.

Job description

Partner Company in the United Arab Emirates is seeking an AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer. This remote contract role requires auditing AI-assisted developer tasks to ensure they are realistic, reproducible, and properly evaluated.

You will provide precise feedback on tooling, IDE integrations, telemetry analysis, and AI-assisted coding workflows to improve AI training tasks and evaluation criteria.