Principal Engineering Lead - Content & Data Pipeline

7741 WILEY APAC SERVICES LLP; Hoboken (NJ); Hybrid; USD 170,000 - 240,000; Full time

Job summary

Wiley, Hoboken, NJ, seeks a Senior Engineering Leader for the Content & Data Pipeline platform. You will own end-to-end architecture, guide ingestion, transformation, and delivery, and grow a team responsible for content from publishers to internal AI/RAG systems and external customers.

You will balance hands-on coding and architecture reviews with coaching, setting standards for reliability, data quality, and observability while aligning with product and licensing stakeholders on a strategic

Qualifications

• Must-have: leadership abilities that scale; hands-on with architecture and code.
• Proven track record coaching and delivering in large engineering teams.

Responsibilities

• Own end-to-end architecture for the content and data pipeline, from ingestion to delivery to internal/external consumers.
• Run production pipelines, manage the content lifecycle, and ensure data quality and observability.
• Lead a team of engineers spanning ingestion, processing, and delivery; coach and unblock the team.
• Partner with product, licensing, and business stakeholders to translate needs into a platform roadmap.
• Manage vendor and licensing-partner relationships and drive architectural ADRs.

Skills

Leadership

Job description

We believe in bold ideas, diverse perspectives, and the drive to transform knowledge into impact. Here, your curiosity fuels progress, your voice shapes innovation, and your ambition helps redefine what's possible within science and learning. We are a culture that obsesses over impact, challenges, and drives what's next to power infinite possibilities for our customers, colleagues and society at large.

About the Role:

About the role

This role leads Wiley's Content & Data Pipeline function - the platform that takes scholarly content (journals, articles, books) from a wide mix of sources through ingestion, processing, and enrichment, and delivers it to internal AI systems, RAG pipelines, and external customers under the right entitlements. It is a hybrid role: you set technical direction and stay hands‑on with architecture and code where it matters, and you also manage and grow a team of engineers who own the day‑to‑day pipeline work.

The role sits alongside an existing dev lead who runs the current content ingestion and delivery pipeline; you take end‑to‑end ownership above that, expanding the platform to cover new source types, new delivery surfaces (especially internal AI / RAG and licensed external delivery), and higher standards of quality, freshness, and observability.

The mandate spans the full content lifecycle - ingestion, transformation, enrichment, metadata management, rights‑aware delivery, and vendor / supplier integration - across scholarly publications and books. Stakeholders include product, business, licensing partners, and vendors, and part of the job is turning their needs into a coherent, prioritized platform roadmap.

We are looking for someone who leads by doing and by coaching - who codes, reviews, unblocks, and mentors, while also owning delivery, and stakeholder alignment for the team.

What you'll do

Technical direction and architecture

Own end‑to‑end architecture for the content and data pipeline: ingestion from vendors and public sources, transformation and enrichment, metadata management, and delivery to internal AI / RAG systems and external customers.

Run and operate the pipeline in production and manage the content lifecycle - corrections, retractions, version updates, metadata deposits and registry syndication, and rights and entitlements enforced at every delivery channels.

Set standards for pipeline reliability, data quality, freshness monitoring, testing, observability, and CI/CD across the team's services.

Codify architectural decisions in ADRs; drive convergence on shared patterns across ingestion, processing, and delivery.

Stay hands‑on - write code, run architecture reviews, prototype, and unblock the team where needed.

Team leadership and delivery

Manage and coach a team of engineers spanning content ingestion, processing, and delivery.

Partner closely with the existing dev lead on the current pipeline; align on ownership boundaries and coordinate roadmap execution.

Own delivery commitments - scope, sequencing, dependencies, and honest tradeoff conversations with stakeholders when reality does not match the plan.

Run engineering practices that scale: code review discipline, on‑call rotation, incident response and postmortems, quality gates in CI.

Stakeholder partnership

Partner with product and business teams on capability priorities - what content the platform ingests next, what delivery surfaces get built, what quality standards matter.

Own vendor and licensing‑partner relationships for content sources and delivery pipes - technical integration, data contracts, escalation, renewal input.

Translate stakeholder needs (editorial ops, product, licensing) into a coherent platform roadmap; push back honestly when requests do not fit the platform's direction.

Communicate technical strategy and tradeoffs upward and outward - not just to peer engineering leaders but to product, business, and executive audiences.

What you’ll own

The Content & Data Pipeline platform end‑to‑end - ingestion through delivery - including architecture, standards, delivery SLAs, and data quality guarantees to internal and external consumers.

The Content & Data Pipeline team - build and delivery

Vendor and licensing‑partner technical relationships for content sources and delivery pipes in scope.

The technical roadmap for expanding the platform to new sources, new delivery surfaces and higher engineering bars, codified in ADRs and communicated to stakeholders.

Must-have skills

• Leadership
• Player‑coach engineering leadership at scale - you have led an engineering team while remaining genuinely hands‑on with architecture and code.