Remote: AI-Workflow Auditor for DevTools (Freelance)

Jobgether

South Africa

On-site

ZAR 1,539,000 - 2,198,000

Full time

8 days ago

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive freelance compensation

Fully remote work from anywhere

Flexible contract format

Technical impact on AI systems

Specialized developer workflow focus

Contractor status: not including HR-s

Contractor equipment: own computer and

Job summary

Jobgether is seeking an AI-Assisted Developer Workflows (Trace) AI Task Auditor - Freelance AI Trainer based in South Africa. You will audit AI-assisted developer workflows to ensure technical soundness, realism, reproducibility, and proper evaluation criteria.

The role offers fully remote contract work and contributes to advancing reliable AI training tasks. Responsibilities include evaluating workflow tasks, identifying issues, assessing IDE integrations and telemetry, testing complex

Qualifications

Experience auditing AI-assisted developer workflows.
Strong analytical and problem-solving abilities.
Ability to communicate findings clearly with concise, actionable feedback.
Ability to work independently in a remote freelance environment.

Responsibilities

Evaluate developer workflow tasks for technical accuracy and reproducibility.
Audit AI-assisted development scenarios for inconsistencies and inefficiencies.
Assess IDE integrations, tooling, telemetry and trace analysis within specialization.
Test and troubleshoot complex scenarios to ensure tasks function as intended.
Provide detailed, actionable feedback to improve AI training and evaluation tasks.