Strategic Project Lead - Software Engineering| $50/hr

Codefeast; United States; Remote; CAD 192,000 - 231,000; Full time

Job summary

Codefeast is seeking a Strategic Project Lead for software engineering data programs serving frontier AI models. You will own production across coding data, RLHF, SWE benchmarks, model evaluations, and agentic coding, with duties spanning delivery, quality, cost, and timelines.

You will coordinate distributed engineers and reviewers, review code and final artifacts, and drive release decisions with minimal training. Immediate start for a 3-month engagement, remote work option.

Qualifications

• Direct experience operating production software-engineering data programs for frontier AI models.
• Ownership of the full production system, including contributor sourcing, calibration, throughput, quality, rework, cost, and delivery recovery.
• Strong ability to read code and tests, inspect final artifacts, and make release or rejection decisions.

Responsibilities

• Operate active software-engineering data and evaluation programs end to end.
• Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
• Track throughput, quality, rework, defects, cost, and delivery timelines.
• Review code, tests, task metadata, and final artifacts for technical correctness.
• Diagnose quality failures and improve task design, rubrics, instructions, and review processes.
• Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.
• Coordinate distributed software engineers, reviewers, and team leads.
• Communicate progress, risks, and corrective actions to customer research and program teams.
• Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.

Skills

Production data programs

Software engineering judgment

Distributed team leadership

Tools

Python

SQL

Job description

Strategic Project Lead - Software Engineering| $100-$120/hr

Qualification:

Proven ownership of production software-engineering data programs for frontier AI models

Job Type:

Contractor position

Location:

Remote

Domain:

Software Engineering | AI Training | Data Evaluation

Role Overview

We are looking for a Strategic Project Lead with direct experience operating software-engineering data programs for frontier AI models. You will own production across coding data, RLHF, SWE benchmarks, model evaluations, and agentic coding. This includes contributor calibration, throughput, quality, rework, cost, timelines, and delivery recovery. The role requires strong technical judgment to read code and tests, inspect final artifacts, and make release or rejection decisions with minimal training.

Key Responsibilities

• Operate active software-engineering data and evaluation programs end to end.
• Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
• Track throughput, quality, rework, defects, cost, and delivery timelines.
• Review code, tests, task metadata, and final artifacts for technical correctness.
• Diagnose quality failures and improve task design, rubrics, instructions, and review processes.
• Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.
• Coordinate distributed software engineers, reviewers, and team leads.
• Communicate progress, risks, and corrective actions to customer research and program teams.
• Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.

Key Requirements

• Direct experience operating production software-engineering data programs for frontier AI models.
• Proven ownership of the full production system, including contributor sourcing, calibration, task throughput, quality, rework, cost management, and delivery recovery.
• Strong software-engineering judgment to read code and tests, inspect final artifacts, identify invalid technical work, and make release or rejection decisions.
• Experience managing distributed software-engineering contributors, reviewers, and team leads.
• Ability to take over an active program quickly, diagnose operational problems independently, and communicate clear decisions.
• A LinkedIn profile is mandatory for review (please ensure your resume includes the link).
• Start Date: Immediate
• Engagement Length: 3 months
• Commitment: 8 hours per day (min 40 hours/week) with at least a 4-hour overlap with PST.
• Vetting: Interest Check Form, AI Interview (~20 mins), Delivery Interview (~45 mins).