Freelance AI Workflow Auditor for Developers - Remote

Jobgether

Ireland

On-site

EUR 83,000 - 119,000

Full time

7 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Competitive freelance compensation

Fully remote

Flexible contract

Technical impact

Specialized work

Contractor status: no benefits

Own equipment required

Job summary

Jobgether seeks an AI-Assisted Developer Workflows (Trace) AI Task Auditor for a freelance project based in Ireland. You will audit AI-assisted developer workflows, ensuring technical soundness, realism, reproducibility, and proper evaluation criteria across complex scenarios.

You’ll provide precise feedback on developer tooling, IDE integrations, telemetry analysis, and AI-assisted coding workflows, contributing to higher quality AI training tasks and practical developer environments.

Qualifications

Demonstrable professional experience in AI-assisted development workflows.
Familiar with AI coding assistants, telemetry/tracing, and IDE integrations.
Strong analytical and problem-solving abilities.
Ability to communicate findings clearly with concise feedback.
Remote freelance work experience and independent task management.

Responsibilities

Evaluate developer workflow tasks for technical accuracy, realism, solvability, reproducibility, and alignment with testing criteria.
Audit AI-assisted development scenarios to identify inconsistencies, logic errors, or inefficiencies.
Assess IDE integrations, tooling, telemetry/trace analysis, and AI-assisted coding workflows.
Test and troubleshoot complex scenarios to ensure tasks function and are reproducible.
Provide clear, actionable feedback to improve AI training and evaluation tasks.
Apply professional judgment to ensure workflows reflect real-world environments.