Principal Engineer: Content & Data Pipeline

Wiley; New Jersey; Hybrid; USD 140,000 - 201,000; Full time

Job summary

Wiley is seeking a leader to own and evolve the Content & Data Pipeline platform, from ingestion through delivery to AI systems. You will code, review, mentor, and guide a team of engineers while partnering with product and licensing to build scalable, observable pipelines.

You’ll set architectural directions, drive reliability, and maintain strong stakeholder communications as Wiley expands into new sources and delivery surfaces.

Qualifications

• Experience leading an engineering team while remaining hands-on with architecture and code.
• Deep production experience designing and operating content or data pipelines at scale.
• Strong knowledge of AWS services and production-grade data pipelines.
• Proficiency in Python and SQL with production-grade code quality.
• Ability to communicate strategy to diverse audiences including executives.

Responsibilities

• Own end-to-end architecture for the content and data pipeline from ingestion to delivery.
• Lead and coach a team of engineers across ingestion, processing, and delivery.
• Partner with product and business teams to translate requirements into a platform roadmap.
• Set reliability, quality, and observability standards and drive CI/CD discipline.
• Maintain stakeholder alignment and deliver on commitments with transparent tradeoffs.

Skills

Leadership at scale

End-to-end pipeline design

AWS production depth

Python

SQL

CI/CD

Observability

Education

Bachelor's degree in a technical field

Tools

Python

SQL

Airflow

Dagster

Kubernetes

CI/CD tooling

Job description

Wiley is seeking a leader to own and evolve the Content & Data Pipeline platform, from ingestion through delivery to AI systems. You will code, review, mentor, and guide a team of engineers while partnering with product and licensing to build scalable, observable pipelines.

You’ll set architectural directions, drive reliability, and maintain strong stakeholder communications as Wiley expands into new sources and delivery surfaces.