Azure Data Engineer: Fabric & Data Lake Pipelines

HarperCollins Publishers; United States; Remote; USD 120,000 - 130,000; Full time

Job summary

HarperCollins Publishers is seeking a Data Engineer to join the Data Management & Engineering team. The role focuses on designing, developing, and maintaining data pipelines across on‑premises SQL Server and Azure, modernizing legacy processing into cloud‑based architecture using Azure Fabric and related services.

You will collaborate with Data Governance and business stakeholders, implement data validation, monitoring, and quality controls, and help deliver reliable Data Products.

Qualifications

• Bachelor’s degree in a related technical field.
• 3–5+ years in data engineering or enterprise data integration.
• Strong SQL Server, T‑SQL, ETL/ELT capabilities.
• Azure Data Factory, Azure Data Lake Storage, and Microsoft Fabric experience.
• Python and PySpark proficiency.

Responsibilities

• Design, develop, and maintain data pipelines using Microsoft Fabric and Azure Data Factory.
• Develop Python, PySpark, and SQL notebooks for ingestion, transformation, and processing across Bronze, Silver, and Gold layers.
• Integrate data from multiple sources and implement data transformations and business rules.
• Optimize pipelines and SQL queries for performance, reliability, and scalability.
• Maintain enterprise Data Products in collaboration with Data Governance.
• Maintain on-premises SQL Server databases and migrate to Azure/Microsoft Fabric.
• Monitor pipelines, troubleshoot failures, and ensure timely delivery of data.

Skills

Strong communication

Analytical skills

Collaboration

Education

Bachelor's degree in Computer Science, Software Engineering, Information Technology, or related technical discipline

3–5+ years in data engineering or enterprise data integration

Tools

Azure Data Factory

Azure Data Lake Storage

Microsoft Fabric

Data Pipelines

Notebooks

Python

PySpark

SQL Server

T-SQL

ETL/ELT Development

SSIS

Job description

HarperCollins Publishers is seeking a Data Engineer to join the Data Management & Engineering team. The role focuses on designing, developing, and maintaining data pipelines across on‑premises SQL Server and Azure, modernizing legacy processing into cloud‑based architecture using Azure Fabric and related services.

You will collaborate with Data Governance and business stakeholders, implement data validation, monitoring, and quality controls, and help deliver reliable Data Products.