Head of Content & Data Pipeline Engineering

1001 John Wiley & Sons, Inc.; Hoboken (NJ); Hybrid; USD 140,000 - 201,000; Full time

Job summary

Wiley seeks a senior leader to own the Content & Data Pipeline platform, guiding ingestion, transformation, enrichment, and delivery to internal AI systems and external customers. You will set technical direction and stay hands-on with architecture and code while coaching a team of engineers who own day-to-day pipeline work.

You will partner with product, licensing, and vendors to define a coherent platform roadmap, expand to new sources and delivery surfaces, and ensure data quality,

Qualifications

• Leadership experience with engineering teams and hands-on architecture.
• Strong background in end-to-end data/content pipelines at scale.
• Proficiency with AWS stack and production-grade data systems.
• Experience in building observable, high-quality software delivery.
• Ability to align stakeholders and translate needs into a roadmap.

Responsibilities

• Own end-to-end architecture for content and data pipeline ingest, transform, enrich, and deliver.
• Lead and coach a team of engineers; collaborate with product, licensing, and vendors.
• Establish standards for reliability, data quality, testing, and CI/CD.
• Deliver on a platform roadmap to cover new sources, surfaces, and capabilities.

Skills

Leadership

Software architecture

AWS depth

Python

SQL

CI/CD

Observability

Team coaching

Education

Bachelor's degree in CS or related

Tools

Airflow

Dagster

Kinesis

S3

ECS/EKS

RDS

DynamoDB

REST APIs

Job description

Wiley seeks a senior leader to own the Content & Data Pipeline platform, guiding ingestion, transformation, enrichment, and delivery to internal AI systems and external customers. You will set technical direction and stay hands-on with architecture and code while coaching a team of engineers who own day-to-day pipeline work.

You will partner with product, licensing, and vendors to define a coherent platform roadmap, expand to new sources and delivery surfaces, and ensure data quality,