Frontier AI Software Data Lead (Contract, 3 Months)

Pylon Management Consulting

San Francisco (CA)

On-site

USD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Pylon Management Consulting seeks a Strategic Project Lead Software Engineering to own production across coding data, RLHF or preference data, SWE benchmarks, model evaluations, agentic coding, code generation, and code repair. This role requires strong technical judgment and the ability to read code and tests, making release or rejection decisions with minimal training.

You will manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance, while tracking throughput,

Qualifications

  • Direct experience operating production software-engineering data programs for frontier AI models.
  • Proven ownership of the full production system, including contributor sourcing and calibration.
  • Strong software-engineering judgment, with the ability to read code and tests, inspect final artifacts, identify invalid technical work, and make release or rejection decisions.
  • Experience managing distributed software-engineering contributors, reviewers, and team leads while maintaining quality and delivery performance.
  • Ability to take over an active program quickly, diagnose operational problems independently, and communicate clear recovery plans to demanding customers.

Responsibilities

  • Operate active software-engineering data and evaluation programs end to end.
  • Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
  • Track throughput, quality, rework, defects, cost, and delivery timelines.
  • Review code, tests, task metadata, and final artifacts for technical correctness.
  • Diagnose quality failures and improve task design, rubrics, instructions, and review processes.
  • Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.
  • Coordinate distributed software engineers, reviewers, and team leads.
  • Communicate progress, risks, and corrective actions to customer research and program teams.
  • Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.

Skills

Ownership of production
Read code/tests
Quality judgment
Release decisions
Distributed team management
Operational problem solving

Tools

Python
SQL

Job description

Pylon Management Consulting seeks a Strategic Project Lead Software Engineering to own production across coding data, RLHF or preference data, SWE benchmarks, model evaluations, agentic coding, code generation, and code repair. This role requires strong technical judgment and the ability to read code and tests, making release or rejection decisions with minimal training.

You will manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance, while tracking throughput,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Strategic Project Lead — AI Software Data Programs
Remote Strategic Project Lead — AI Software Data Programs

Codefeast • United States

Remote
CAD 192,000 - 231,000
Remote Strategic Frontier AI Data Programs Lead
Remote Strategic Frontier AI Data Programs Lead

Dover • United States

Remote
USD 83,000 - 165,000
Strategic Project Lead Software Engineering
Strategic Project Lead Software Engineering

Pylon Management Consulting • San Francisco (CA)

On-site
USD 120,000 - 180,000
Strategic AI Data Program Lead (Remote, Contract)
Strategic AI Data Program Lead (Remote, Contract)

Codefeast • United States

Remote
USD 138,000 - 165,000
Strategic Project Lead - Software Engineering| $100-$120/hr
Strategic Project Lead - Software Engineering| $100-$120/hr

Codefeast • United States

Remote
USD 138,000 - 165,000
Strategic Project Lead - Software Engineering| $50/hr
Strategic Project Lead - Software Engineering| $50/hr

Codefeast • United States

Remote
CAD 192,000 - 231,000
Remote Strategic Projects Lead – AI Data Pipelines
Remote Strategic Projects Lead – AI Data Pipelines

Xperteez Technology • United States

Remote
USD 110,000 - 170,000
Strategic Project Lead – Software Engineering
Strategic Project Lead – Software Engineering

CareerFlow • United States

Remote
USD 83,000 - 165,000
Frontier AI Data Operations Lead
Frontier AI Data Operations Lead

Mercor • New York (NY)

On-site
USD 120,000 - 150,000
Relocation bonus
Housing bonus near office
Meals stipend
+5
Frontier AI Projects Lead
Frontier AI Projects Lead

Replay • New York (NY)

On-site
USD 175,000 - 220,000
Equity
Health insurance
Unlimited PTO
+3