AI Production Programs Lead

Jobs in JS; United States; On-site; USD 150,000 - 190,000; Full time

Job summary

Gramian Consultancy is seeking an experienced Technical Program Operations Lead to own production systems behind large-scale AI and software-engineering data programs. You will turn complex research requirements into predictable delivery across quality, throughput, contributor performance, timelines, and cost.

This operations leadership role demands inspecting code, understanding tests, analyzing quality signals, and improving workflows at scale.

Qualifications

• Proven experience leading complex, multi-stakeholder programs in software engineering or technical operations.
• Strong analytical and problem-solving skills with ability to identify bottlenecks and improve delivery.
• Ability to read and review code, understand tests, and translate research objectives into actionable task specifications.

Responsibilities

• Own end-to-end program delivery across scope, timelines, quality, throughput, contributor performance, and cost.
• Design and manage workflows for coding datasets, agentic trajectories, RL environments, benchmarks, and rubric-based evaluations.
• Identify operational bottlenecks and improve workflows through better instructions, sequencing, incentives, review systems, and capacity planning.
• Define contributor requirements and partner with talent teams to source, assess, onboard, train, and ramp distributed software engineers.
• Build team-lead and reviewer structures for programs involving 100–1,000+ contributors.
• Own quality-control systems and analyze datasets to identify trends, systematic errors, and root causes.
• Act as a primary customer contact for AI labs, communicating progress, risks, quality trends, and recovery plans.
• Translate research objectives into practical task specifications and challenge requirements when they may not produce the intended evaluation signal.
• Use Python, SQL, or similar tools to automate quality sampling, defect analysis, throughput reporting, and operational reviews.
• Convert successful workflows into reusable playbooks, quality controls, evaluation assets, and contributor-management systems.
• Share operational learnings and mentor other program leads.

Job description

Gramian Consultancy is seeking an experienced Technical Program Operations Lead to own production systems behind large-scale AI and software-engineering data programs. You will turn complex research requirements into predictable delivery across quality, throughput, contributor performance, timelines, and cost.

This operations leadership role demands inspecting code, understanding tests, analyzing quality signals, and improving workflows at scale.