AI Developer Trace Task Auditor

HumanitApp; Northern (KY); Hybrid; USD 96,000 - 124,000; Full time

Job summary

HumanitApp is seeking an AI-evaluation professional to assess AI-assisted software-development traces used to train and evaluate frontier AI models. You will review end-to-end coding sessions produced with AI developer tools, judging correctness, workflow soundness, and reasoning.

The role offers compensation in the $70-$90 per hour range, with a 40-hour week; final rate, workload, and payment terms will be confirmed during the official application process.

Qualifications

• Experience in AI evaluation.

Responsibilities

• Evaluate AI-assisted software-development traces for accuracy, workflow soundness, and reasoning.

Job description

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools

judging correctness, workflow soundness, and reasoning

and provide clear, rubric-based written...

AI evaluation

Who this role may fit

This opportunity may suit professionals with relevant experience in AI evaluation. Review the official description and requirements before applying.

Compensation context

The listing states $70 - $90 / hour. Confirm the final rate, workload, and payment terms during the official application process.

• You can show recent, specific work involving AI evaluation.
• The listed commitment of 40 hours/week fits your schedule.
• You can communicate your reasoning clearly in the application language.
• You are comfortable with project availability and hours varying over time.

How should I compare the listed pay?

Does Apply use a referral link?

No. HumanitApp independently curates the opportunity. The partner platform manages applications and hiring decisions.

Is HumanitApp the employer?

No. HumanitApp independently curates the opportunity. The partner platform manages applications and hiring decisions.