Technical Task Auditor — AWS Serverless IaC Task Auditor

Meridial; United States; Remote; USD 83,000 - 152,000; Full time

Job summary

Meridial seeks experienced technical experts to contribute to an independent contractor opportunity focused on auditing AI training/evaluation tasks. Experts will be matched to one specialty—from GPU kernels to Kubernetes and more—based on their background. They will assess task accuracy, realism, solvability, reproducibility, and test support, and provide clear feedback.

Interested experts will complete a technical assessment related to their area of expertise as part of the selection process.

Qualifications

• Experience auditing tasks for AI training/evaluation.
• Ability to assess realism, solvability, reproducibility, and tests.
• Provide actionable feedback with clear criteria.

Responsibilities

• Match to a specialty based on expertise.
• Complete required assessments and report results.
• Ensure tasks are accurate and supported by tests.

Skills

GPU kernels

AWS Trainium & NKI

CVE & security

Machine learning

AI-assisted workflows

AWS Serverless & IaC

Kubernetes

SWE-Bench

Job description

We are seeking experienced technical experts to contribute to an independent contractor opportunity focused on auditing tasks used to train and evaluate AI systems.
Experts will be matched to one specialty based on their experience:

• GPU kernels

• AWS Trainium and NKI

• CVE and application security

• Machine learning

• AI-assisted developer workflows

• AWS Serverless and Infrastructure as Code

• Kubernetes

• SWE-Bench

Experts will assess whether technical tasks are accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria. They will also provide clear, actionable feedback on any issues identified.
Expertise across all eight specialties is not required. Interested experts will complete a technical assessment related to their area of expertise as part of the selection process.

Required assessments

• AWS Serverless Task Auditor Assessment (50 min)