Strategic Project Lead Software Engineering

Pylon Management Consulting

San Francisco (CA)

On-site

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Pylon Management Consulting seeks a Strategic Project Lead Software Engineering to own production across coding data, RLHF or preference data, SWE benchmarks, model evaluations, agentic coding, code generation, and code repair. This role requires strong technical judgment and the ability to read code and tests, making release or rejection decisions with minimal training.

You will manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance, while tracking throughput,

Qualifications

  • Direct experience operating production software-engineering data programs for frontier AI models.
  • Proven ownership of the full production system, including contributor sourcing and calibration.
  • Strong software-engineering judgment, with the ability to read code and tests, inspect final artifacts, identify invalid technical work, and make release or rejection decisions.
  • Experience managing distributed software-engineering contributors, reviewers, and team leads while maintaining quality and delivery performance.
  • Ability to take over an active program quickly, diagnose operational problems independently, and communicate clear recovery plans to demanding customers.

Responsibilities

  • Operate active software-engineering data and evaluation programs end to end.
  • Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
  • Track throughput, quality, rework, defects, cost, and delivery timelines.
  • Review code, tests, task metadata, and final artifacts for technical correctness.
  • Diagnose quality failures and improve task design, rubrics, instructions, and review processes.
  • Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.
  • Coordinate distributed software engineers, reviewers, and team leads.
  • Communicate progress, risks, and corrective actions to customer research and program teams.
  • Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.

Skills

Ownership of production
Read code/tests
Quality judgment
Release decisions
Distributed team management
Operational problem solving

Tools

Python
SQL

Job description

Job description

Role: Strategic Project Lead Software Engineering

Duration of contract: Flexible 40 hrs/week, 3 Months

Work time and required hours: Flexible, 40 hrs/week with 4 hours of overlap with PST

Start Date : Immediate

Role Overview

We are looking for a Strategic Project Lead with direct experience operating software-engineering data programs for frontier AI models.

You will own production across coding data, RLHF or preference data, SWE benchmarks, model evaluations, agentic coding, code generation, and code repair. This includes contributor calibration, throughput, quality, rework, cost, timelines, and delivery recovery.

The role requires strong technical judgment. You should be able to read code and tests, inspect final artifacts, identify invalid work, and make release or rejection decisions with minimal training.

We need candidates who have already operated in software-engineering data programs for frontier models. This is not a general AI TPM, enterprise AI delivery or data-platform role. The candidate should be able to take over an active SWE data project with minimal training

Should have personally owned one or more of the following:

  • Coding training or post-training data
  • Coding RLHF or preference data
  • SWE benchmarks or model evaluations
  • Agentic coding environments
  • Code-generation or code-repair datasets
  • The candidate must have owned the production system, including SWE contributor sourcing and calibration, task throughput, quality, rework, cost and delivery recovery.

Should be able to read code and tests, inspect the final artifact, diagnose why an invalid task passed QA, and make a release or rejection decision

What Does Day-to-Day Look Like?

  • Operate active software-engineering data and evaluation programs end to end.
  • Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
  • Track throughput, quality, rework, defects, cost, and delivery timelines.
  • Review code, tests, task metadata, and final artifacts for technical correctness.
  • Diagnose quality failures and improve task design, rubrics, instructions, and review processes.
  • Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.
  • Coordinate distributed software engineers, reviewers, and team leads.
  • Communicate progress, risks, and corrective actions to customer research and program teams.
  • Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.

Requirements

  • Direct experience operating production software-engineering data programs for frontier AI models, preferably involving coding training, coding RLHF, SWE benchmarks, model evaluations, agentic coding, code generation, or code repair.
  • Proven ownership of the full production system, including contributor sourcing and calibration, task throughput, quality, rework, cost management, and delivery recovery.
  • Strong software-engineering judgment, with the ability to read code and tests, inspect final artifacts, identify invalid technical work, and make release or rejection decisions.
  • Experience managing distributed software-engineering contributors, reviewers, and team leads while maintaining consistent quality and delivery performance.
  • Ability to take over an active program quickly, diagnose operational problems independently, and communicate clear decisions and recovery plans to demanding customers.

Evaluation Process :

  • AI Interview (~20 mins)
  • Delivery interview (~45 mins)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Strategic Project Lead - Software Engineering| $100-$120/hr
Strategic Project Lead - Software Engineering| $100-$120/hr

Codefeast • United States

Remote
USD 138,000 - 165,000
Strategic Project Lead - Software Engineering| $50/hr
Strategic Project Lead - Software Engineering| $50/hr

Codefeast • United States

Remote
CAD 192,000 - 231,000
Strategic Project Lead – Software Engineering
Strategic Project Lead – Software Engineering

CareerFlow • United States

Remote
USD 83,000 - 165,000
Strategic Project Lead – Software Engineering
Strategic Project Lead – Software Engineering

HumanitApp • San Francisco (CA)

Hybrid
USD 165,000 - 248,000
Remote work
Flexible engagement
Remote Strategic Project Lead — AI Software Data Programs
Remote Strategic Project Lead — AI Software Data Programs

Codefeast • United States

Remote
CAD 192,000 - 231,000
Strategic Project Lead, Coding/SWE- Remote- Full Time
Strategic Project Lead, Coding/SWE- Remote- Full Time

Xperteez Technology • United States

Remote
USD 110,000 - 170,000
Software Engineer
Software Engineer

Prointegrate World It Consulting • United States

Remote
USD 120,000 - 180,000
Strategic AI Data Program Lead (Remote, Contract)
Strategic AI Data Program Lead (Remote, Contract)

Codefeast • United States

Remote
USD 138,000 - 165,000
Frontier AI Software Data Lead (Contract, 3 Months)
Frontier AI Software Data Lead (Contract, 3 Months)

Pylon Management Consulting • San Francisco (CA)

On-site
USD 120,000 - 180,000
Remote | Strategic Project Lead, Coding/SWE — $300,000–$500,000/year
Remote | Strategic Project Lead, Coding/SWE — $300,000–$500,000/year

24-MAG • United States

Remote
USD 300,000 - 500,000