Strategic AI Data Program Lead (Remote, Contract)

Codefeast; United States; Remote; USD 138,000 - 165,000; Part time

Job summary

Codefeast is seeking a Strategic Project Lead with hands-on experience running production software-engineering data programs for frontier AI models. You will own end-to-end data workflows, RLHF processes, SWE benchmarks, and model evaluations, while managing contributors, timelines, and costs.

The role requires strong technical judgment to review code and artifacts, make release decisions, and drive delivery if plans slip.

Qualifications

• Direct experience operating production software-engineering data programs for frontier AI models.
• Proven ownership of the full production system, including contributor sourcing, calibration, task throughput, quality, rework, cost, and delivery recovery.
• Strong software-engineering judgment to read code and tests, inspect final artifacts, and make release or rejection decisions.

Responsibilities

• Operate active software-engineering data and evaluation programs end to end.
• Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
• Track throughput, quality, rework, defects, cost, and delivery timelines.
• Review code, tests, task metadata, and final artifacts for technical correctness.
• Diagnose quality failures and improve task design, rubrics, instructions, and review processes.
• Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.
• Coordinate distributed software engineers, reviewers, and team leads.
• Communicate progress, risks, and corrective actions to customer research and program teams.
• Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.

Skills

Python

SQL

Software engineering

Data evaluation

Job description

Codefeast is seeking a Strategic Project Lead with hands-on experience running production software-engineering data programs for frontier AI models. You will own end-to-end data workflows, RLHF processes, SWE benchmarks, and model evaluations, while managing contributors, timelines, and costs.

The role requires strong technical judgment to review code and artifacts, make release decisions, and drive delivery if plans slip.