Independent AI Task Auditor — Technical Expert

Meridial; United States; Remote; USD 83,000 - 165,000; Part time

Job summary

Meridial is seeking experienced technical experts for an independent contractor role focused on auditing tasks used to train and evaluate AI systems. You will be matched to a specialty such as GPU kernels, AWS Trainium, CVE/security, ML, AI-assisted workflows, AWS Serverless, Kubernetes, or SWE-Bench based on your experience.

Experts will assess task validity, realism, solvability, reproducibility, and support by tests and evaluation criteria, and provide actionable feedback.

Qualifications

• Experience auditing AI/ML systems or related software.
• Ability to assess accuracy, solvability, reproducibility, and test coverage.
• Willingness to complete targeted technical assessments during selection.

Responsibilities

• Assess technical tasks for accuracy, realism, solvability, and reproducibility.
• Provide clear, actionable feedback on issues identified with evaluation criteria and tests.

Skills

AI auditing

SWE-Bench

Machine learning

GPU kernels

Kubernetes

AWS Trainium

Security testing

AI-assisted developer workflows

Tools

Kubernetes

AWS

Job description

Meridial is seeking experienced technical experts for an independent contractor role focused on auditing tasks used to train and evaluate AI systems. You will be matched to a specialty such as GPU kernels, AWS Trainium, CVE/security, ML, AI-assisted workflows, AWS Serverless, Kubernetes, or SWE-Bench based on your experience.

Experts will assess task validity, realism, solvability, reproducibility, and support by tests and evaluation criteria, and provide actionable feedback.