Technical Task Auditor

Meridial; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

Meridial is seeking experienced technical experts for an independent contractor opportunity focused on auditing tasks used to train and evaluate AI systems. Experts will be matched to one specialty based on their experience and will assess accuracy, realism, solvability, reproducibility, and test coverage.

Selected experts will complete a targeted technical assessment in their area, with assignments ranging across Kubernetes, GPU kernels, SWE-Bench, and related ML/AI workflows.

Qualifications

• Experience auditing AI training tasks across multiple domains.
• Ability to assess accuracy, realism, solvability, reproducibility, and tests.
• Willingness to complete a focused assessment in your area.

Responsibilities

• Audit technical tasks for accuracy and test coverage.
• Provide clear, actionable feedback on issues.
• Complete assessments as part of the selection process.

Skills

Kubernetes

GPU Kernels

AWS Serverless

ML

AI Workflows

CVE Security

SWE-Bench

Security Testing

Job description

We are seeking experienced technical experts to contribute to an independent contractor opportunity focused on auditing tasks used to train and evaluate AI systems. Experts will be matched to one specialty based on their experience.

• GPU kernels
• AWS Trainium and NKI
• CVE and application security
• Machine learning
• AI-assisted developer workflows
• AWS Serverless and Infrastructure as Code
• Kubernetes
• SWE-Bench

Experts will assess whether technical tasks are accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria. They will also provide clear, actionable feedback on any issues identified. Expertise across all eight specialties is not required. Interested experts will complete a technical assessment related to their area of expertise as part of the selection process.

Required assessments

• Kubernetes Task Auditor Competency Evaluation (50 min)
• SWE-Bench Task Auditor Assessment (50 min)
• AWS Serverless Task Auditor Assessment (50 min)
• Developer Trace Auditor Assessment (50 min)
• ML Challenge Auditor Assessment (50 min)
• CVE Vulnerability Task Auditor Assessment (50 min)
• TRN Kernel Task Auditor Assessment (50 min)
• GPU Kernel Task Auditor Performance Assessment (40 min)