Independent AI Task Auditor – CVE & Security Vetting

Meridial; United States; Remote; USD 83,000 - 165,000; Full time

Job summary

Meridial is seeking experienced technical experts for an independent contractor opportunity focusing on auditing tasks used to train and evaluate AI systems. Experts will be matched to one specialty based on their experience, including GPU kernels, AWS Trainium/NKI, CVE and security, ML, AI-assisted workflows, AWS Serverless/IaC, Kubernetes, and SWE-Bench.

Experts will assess task validity, realism, solvability, and reproducibility, and provide clear, actionable feedback.

Qualifications

• Auditing tasks for AI system training/evaluation
• Ability to assess accuracy, realism, solvability, and reproducibility of tasks
• Provide clear, actionable feedback and participate in a technical assessment

Responsibilities

• Assess tasks for accuracy, realism, solvability, reproducibility, and test criteria
• Provide feedback and participate in the technical assessment as part of selection process

Skills

GPU kernels

AWS Trainium

NKI

CVE vulnerabilities

Application security

Machine learning

AI-assisted workflows

Kubernetes

SWE-Bench

Job description

Meridial is seeking experienced technical experts for an independent contractor opportunity focusing on auditing tasks used to train and evaluate AI systems. Experts will be matched to one specialty based on their experience, including GPU kernels, AWS Trainium/NKI, CVE and security, ML, AI-assisted workflows, AWS Serverless/IaC, Kubernetes, and SWE-Bench.

Experts will assess task validity, realism, solvability, and reproducibility, and provide clear, actionable feedback.