Strategic Project Lead - Software Engineering| $100-$120/hr

Codefeast; United States; Remote; USD 138.000 - 165.000; Teilzeit

Zusammenfassung

Codefeast is seeking a Strategic Project Lead with hands-on experience running production software-engineering data programs for frontier AI models. You will own end-to-end data workflows, RLHF processes, SWE benchmarks, and model evaluations, while managing contributors, timelines, and costs.

The role requires strong technical judgment to review code and artifacts, make release decisions, and drive delivery if plans slip.

Qualifikationen

• Direct experience operating production software-engineering data programs for frontier AI models.
• Proven ownership of the full production system, including contributor sourcing, calibration, task throughput, quality, rework, cost, and delivery recovery.
• Strong software-engineering judgment to read code and tests, inspect final artifacts, and make release or rejection decisions.

Aufgaben

• Operate active software-engineering data and evaluation programs end to end.
• Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
• Track throughput, quality, rework, defects, cost, and delivery timelines.
• Review code, tests, task metadata, and final artifacts for technical correctness.
• Diagnose quality failures and improve task design, rubrics, instructions, and review processes.
• Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.
• Coordinate distributed software engineers, reviewers, and team leads.
• Communicate progress, risks, and corrective actions to customer research and program teams.
• Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.

Kenntnisse

Python

SQL

Software engineering

Data evaluation

Jobbeschreibung

Strategic Project Lead - Software Engineering| $100-$120/hr

Qualification:

Proven ownership of production software-engineering data programs for frontier AI models

Job Type:

Contractor position

Location:

Remote

Domain:

Software Engineering | AI Training | Data Evaluation

Role Overview

We are looking for a Strategic Project Lead with direct experience operating software-engineering data programs for frontier AI models. You will own production across coding data, RLHF, SWE benchmarks, model evaluations, and agentic coding. This includes contributor calibration, throughput, quality, rework, cost, timelines, and delivery recovery. The role requires strong technical judgment to read code and tests, inspect final artifacts, and make release or rejection decisions with minimal training.

Key Responsibilities

• Operate active software-engineering data and evaluation programs end to end.
• Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
• Track throughput, quality, rework, defects, cost, and delivery timelines.
• Review code, tests, task metadata, and final artifacts for technical correctness.
• Diagnose quality failures and improve task design, rubrics, instructions, and review processes.
• Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.
• Coordinate distributed software engineers, reviewers, and team leads.
• Communicate progress, risks, and corrective actions to customer research and program teams.
• Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.

Key Requirements

• Direct experience operating production software-engineering data programs for frontier AI models.
• Proven ownership of the full production system, including contributor sourcing, calibration, task throughput, quality, rework, cost management, and delivery recovery.
• Strong software-engineering judgment to read code and tests, inspect final artifacts, identify invalid technical work, and make release or rejection decisions.
• Experience managing distributed software-engineering contributors, reviewers, and team leads.
• Ability to take over an active program quickly, diagnose operational problems independently, and communicate clear decisions.
• A LinkedIn profile is mandatory for review (please ensure your resume includes the link).
• Start Date: Immediate
• Engagement Length: 3 months
• Commitment: 8 hours per day (min 40 hours/week) with at least a 4-hour overlap with PST.
• Vetting: Interest Check Form, AI Interview (~20 mins), Delivery Interview (~45 mins).