Data Engineer (remote US)

HarperCollins Publishers; United States; Remote; USD 120,000 - 130,000; Full time

Job summary

HarperCollins Publishers is seeking a Data Engineer to join the Data Management & Engineering team. The role focuses on designing, developing, and maintaining data pipelines across on‑premises SQL Server and Azure, modernizing legacy processing into cloud‑based architecture using Azure Fabric and related services.

You will collaborate with Data Governance and business stakeholders, implement data validation, monitoring, and quality controls, and help deliver reliable Data Products.

Qualifications

• Bachelor’s degree in a related technical field.
• 3–5+ years in data engineering or enterprise data integration.
• Strong SQL Server, T‑SQL, ETL/ELT capabilities.
• Azure Data Factory, Azure Data Lake Storage, and Microsoft Fabric experience.
• Python and PySpark proficiency.

Responsibilities

• Design, develop, and maintain data pipelines using Microsoft Fabric and Azure Data Factory.
• Develop Python, PySpark, and SQL notebooks for ingestion, transformation, and processing across Bronze, Silver, and Gold layers.
• Integrate data from multiple sources and implement data transformations and business rules.
• Optimize pipelines and SQL queries for performance, reliability, and scalability.
• Maintain enterprise Data Products in collaboration with Data Governance.
• Maintain on-premises SQL Server databases and migrate to Azure/Microsoft Fabric.
• Monitor pipelines, troubleshoot failures, and ensure timely delivery of data.

Skills

Strong communication

Analytical skills

Collaboration

Education

Bachelor's degree in Computer Science, Software Engineering, Information Technology, or related technical discipline

3–5+ years in data engineering or enterprise data integration

Tools

Azure Data Factory

Azure Data Lake Storage

Microsoft Fabric

Data Pipelines

Notebooks

Python

PySpark

SQL Server

T-SQL

ETL/ELT Development

SSIS

Job description

Overview

HarperCollins is seeking a Data Engineer to join our Data Management & Engineering team. The successful candidate will be responsible for developing, maintaining, and supporting enterprise data integration processes and pipelines across both on-premises SQL Server and Microsoft Azure environments.

This role will support the ongoing modernization of legacy data processing solutions into cloud-based architecture, leveraging Microsoft Fabric, Azure Data Lake, and enterprise Data Products.

The ideal candidate will have strong SQL and data engineering skills, hands‑on experience with Azure technologies, and the ability to translate business requirements into reliable, scalable, and well‑documented technical solutions.

The position requires close collaboration with Data Governance, business stakeholders, application teams, and other engineering resources to ensure data is processed accurately, efficiently, and consistently across enterprise platforms.

Responsibilities

Data Engineering & Cloud Development

• Design, develop, and maintain data pipelines using Microsoft Fabric, Azure Data Factory, and related Azure technologies.
• Develop Python, PySpark, and SQL notebooks for data ingestion, transformation, and processing across Bronze, Silver, and Gold layers.
• Integrate data from multiple sources, including files, databases, APIs, and enterprise applications.
• Implement data transformations, enrichment, aggregations, and business rules based on approved specifications.
• Optimize pipelines and SQL queries for performance, reliability, and scalability.
• Develop and maintain enterprise Data Products in collaboration with Data Governance.

Legacy System Support, Data Processing & Operations

• Maintain on-premises SQL Server databases, stored procedures, and ETL processes while supporting their migration to Azure and Microsoft Fabric.
• Develop and maintain automated, rule‑based processing workflows, including queue‑driven processing and batch orchestration.
• Manage file‑based ingestion, feed tracking, processing status, and downstream data distribution.
• Implement data validation, reconciliation, logging, monitoring, and exception handling.
• Monitor production pipelines, troubleshoot failures and data discrepancies, and implement corrective actions.
• Ensure continuity, reliability, and timely delivery of business‑critical data processes

Business Collaboration, Technical Documentation & Quality

• Collaborate with business stakeholders and Data Governance to understand requirements, data definitions, business rules, and approved Data Product specifications.
• Translate business requirements into technical designs, identifying source data gaps, dependencies, and process improvements.
• Maintain technical documentation, including data flows, source‑to‑target mappings, transformation logic, and operational procedures.
• Perform unit and integration testing, support QA and business sign‑off, and adhere to established development, deployment, and Data Governance standards.

Qualifications

Education & Experience

• Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline.
• 3–5+ years of hands‑on experience in data engineering, database development, or enterprise data integration in building pipelines, migrating data and modernization of environments.

Technical Skills:

• SQL & Data Engineering: Strong proficiency in SQL Server, T‑SQL, stored procedures, query optimization, and ETL/ELT development.
• Azure & Microsoft Fabric: Hands‑on experience with Azure Data Factory, Azure Data Lake Storage, and Microsoft Fabric, including Data Pipelines, Lakehouse, and Notebooks.
• Programming & Data Architecture: Proficiency in Python and/or PySpark, with an understanding of data warehousing, relational data modeling, and Medallion Architecture.
• Integration & Operations: Experience with file‑based integrations, batch processing, queue‑driven workflows, data validation, monitoring, troubleshooting, and production support. Familiarity with SSIS or legacy ETL tools is an asset.
• Preferred Qualifications: Experience modernizing legacy data platforms and relevant Microsoft certifications are considered assets.

Additional Skills:

• Strong communication and collaboration skills, with the ability to engage business stakeholders, Data Governance, and technical teams to translate requirements into effective solutions.
• Strong analytical and problem‑solving abilities, with attention to data accuracy, quality, and operational reliability

The salary range for this position is $120,000-$130,000. We recognize that attracting the best talent is key to our strategy and success as a company. As a result, we aim for flexibility in structuring competitive compensation offers to ensure we are able to attract the best candidates. The quoted salary range represents our good faith estimate as to what our ideal candidates are likely to expect, and we tailor our offers within the range based on the selected candidate's experience, industry knowledge, technical and communication skills, and other factors that may prove relevant during the interview process.

In addition to cash compensation, the company provides a comprehensive and highly competitive benefits package, with a variety of physical health, retirement and savings, caregiving, emotional wellbeing, transportation, and other benefits, including "elective" benefits employees may select to best fit the needs and personal situations of our diverse workforce. Visit our careers webpage for more information.

HarperCollins Publishers is an equal opportunity employer.

HarperCollins Publishers is committed to providing reasonable accommodation for qualified individuals with disabilities, in our job application and/or interview process. If you need assistance or accommodation in completing your application, due to a disability, email us at [e-mail]. Note: we will only respond to accommodation requests.