Technical Task Auditor — GPU Kernel Task Auditor

Meridial; United States; Remote; USD 83,000 - 165,000; Part time

Job summary

Meridial is seeking experienced technical experts for an independent contractor opportunity focused on auditing tasks used to train and evaluate AI systems. Experts will be matched to one specialty based on their experience from eight listed areas, and will complete a technical assessment as part of the selection process.

Experts will assess tasks for accuracy, realism, solvability, reproducibility, and will provide actionable feedback on issues identified.

Qualifications

• Proven experience auditing AI-related tasks in at least one specialty.
• Ability to provide clear, actionable feedback based on findings.
• Willingness to complete a technical assessment during selection.

Responsibilities

• Assess tasks for accuracy, realism, solvability, and reproducibility; ensure tests and evaluation criteria are reliable.
• Provide clear, actionable feedback on issues identified during audits.

Skills

GPU kernels

AWS Trainium and NKI

CVE and application security

Machine learning

AI-assisted developer workflows

AWS Serverless and Infrastructure as C

Kubernetes

SWE-Bench

Job description

We are seeking experienced technical experts to contribute to an independent contractor opportunity focused on auditing tasks used to train and evaluate AI systems.
Experts will be matched to one specialty based on their experience:

• GPU kernels
• AWS Trainium and NKI
• CVE and application security
• Machine learning
• AI-assisted developer workflows
• AWS Serverless and Infrastructure as Code
• Kubernetes
• SWE-Bench

Experts will assess whether technical tasks are accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria. They will also provide clear, actionable feedback on any issues identified.
Expertise across all eight specialties is not required. Interested experts will complete a technical assessment related to their area of expertise as part of the selection process.

Required assessments

• GPU Kernel Task Auditor Performance Assessment (40 min)