Remote AI Workflow Auditor for Developer Tools

Meridial; United States; Remote; USD 96,000 - 138,000; Full time

Benefits offered by this job

Remote freelance opportunity

Job summary

Meridial is seeking an AI-Assisted Developer Workflows AI Task Auditor for a Freelance AI Trainer Project. This remote opportunity focuses on auditing tasks used to train and evaluate AI systems, ensuring technical rigor and accuracy within your area of expertise.

You will assess task realism, reproducibility, tests, and evaluation criteria, and provide actionable feedback on IDE integration faults, AI-assisted coding inefficiencies, and logic errors to improve training workflows.

Qualifications

• Proven expertise in modern developer tooling and AI coding assistants.
• Strong analytical and problem-solving abilities to test and evaluate scenarios.
• Experience with telemetry/trace analysis and developer workflows.

Responsibilities

• Audit developer workflow tasks for accuracy, solvability, reproducibility, and tests.
• Provide actionable feedback on IDE integration faults and AI-assisted coding inefficiencies.
• Assess tasks for reliability and evaluation criteria.

Skills

Modern developer tooling

AI coding assistants

Telemetry/trace analysis

Developer workflow ecosystems

Analytical and problem-solving skills

Job description

Meridial is seeking an AI-Assisted Developer Workflows AI Task Auditor for a Freelance AI Trainer Project. This remote opportunity focuses on auditing tasks used to train and evaluate AI systems, ensuring technical rigor and accuracy within your area of expertise.

You will assess task realism, reproducibility, tests, and evaluation criteria, and provide actionable feedback on IDE integration faults, AI-assisted coding inefficiencies, and logic errors to improve training workflows.