Cloud Data Engineer - Azure Pipelines, SQL & Python

HarperCollins; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

HarperCollins is seeking a data engineer to design, develop, and maintain data pipelines in a modern Azure-based environment. You will integrate data from multiple sources, implement transformations and business rules, and support legacy SQL Server ETL while migrating to cloud architecture.

Collaborate with Data Governance and business stakeholders, maintain technical docs, and monitor production pipelines to troubleshoot issues.

Qualifications

• 3-5+ years of hands-on data engineering experience.
• Strong proficiency in SQL, Python, and Azure technologies.
• Experience with data warehousing, Medallion Architecture, and production support.

Responsibilities

• Design, develop, and maintain data pipelines using Microsoft Fabric, Azure Data Factory, and related Azure technologies.
• Integrate data from multiple sources and implement transformations, enrichment, and business rules.
• Support legacy SQL Server and ETL processes while migrating to cloud-based architecture.
• Collaborate with Data Governance and business stakeholders to understand requirements and data definitions.
• Maintain technical documentation and perform unit and integration testing.
• Monitor production pipelines and troubleshoot failures.

Skills

Data engineering

SQL

Python

Azure technologies

Data warehousing

Tools

Azure Data Factory

Microsoft Fabric

Job description

HarperCollins is seeking a data engineer to design, develop, and maintain data pipelines in a modern Azure-based environment. You will integrate data from multiple sources, implement transformations and business rules, and support legacy SQL Server ETL while migrating to cloud architecture.

Collaborate with Data Governance and business stakeholders, maintain technical docs, and monitor production pipelines to troubleshoot issues.