Principal Engineer: Content & Data Pipeline Leader

Wiley; Hoboken (NJ); Hybrid; USD 140,000 - 201,000; Full time

Benefits offered by this job

Equal opportunity employer

Meeting-free Friday afternoons

Comprehensive benefits package

Job summary

Wiley is seeking a senior leader to own and expand the Content & Data Pipeline platform. You will guide architecture, deliver end-to-end ingestion, processing, and delivery for scholarly content, and coach a team of engineers responsible for ingestion, processing, and delivery.

You'll partner with product, licensing, and vendors to align on a coherent roadmap, maintain high quality and observability, and drive delivery commitments in a complex, fast-moving environment.

Qualifications

• Proven leadership in engineering at scale with hands-on architecture and code.
• Strong cross-functional influence with product, business, vendors, and executives.
• Deep production experience designing and operating end-to-end data/content pipelines.
• Experience with AWS production services and cost fluency.
• Python and SQL in production environments.
• Knowledge of CI/CD, testing, and data-quality practices.

Responsibilities

• Own end-to-end architecture for content and data pipelines from ingestion to delivery.
• Lead and coach a team of engineers across ingestion, processing, and delivery.
• Partner with product and licensing teams to shape platform roadmap.
• Drive reliability, observability, and data quality across services.
• Communicate strategy and tradeoffs to stakeholders and executives.

Skills

Leadership

Architecture

AWS

Python

SQL

Data pipelines

CI/CD

Observability

Mentoring

Distributed systems

Tools

Airflow

Dagster

Kinesis

ETL tooling

Job description

Wiley is seeking a senior leader to own and expand the Content & Data Pipeline platform. You will guide architecture, deliver end-to-end ingestion, processing, and delivery for scholarly content, and coach a team of engineers responsible for ingestion, processing, and delivery.

You'll partner with product, licensing, and vendors to align on a coherent roadmap, maintain high quality and observability, and drive delivery commitments in a complex, fast-moving environment.