Azure Data Engineer: Data Pipelines & Lakes Expert

HTC Global Services; Grand Rapids (MI); Sur place; USD 110 000 - 140 000; Plein temps

Avantages offerts par ce poste

Group Health & Vision

Paid Time Off

401(k) matching

Life & Disability Insurance

Professional Development opportunities

Résumé du poste

HTC Global Services is seeking an Azure Data Engineer to design and maintain scalable data pipelines on Azure. You will work with Azure Data Factory and Data Lake Storage to ingest, transform, and store data for cloud analytics and warehousing.

The role emphasizes building reliable ETL/ELT workflows, collaborating with stakeholders, and supporting migration of on-premises data to Azure. Strong SQL, Spark, and data modeling skills are required to drive secure, governed data platforms.

Qualifications

• Expertise in Azure Data Factory for data pipeline development and maintenance (ADF).
• Experience with Azure Data Lake Storage and enterprise-scale data lakes.
• Experience developing ETL/ELT workflows for data ingestion from multiple sources.
• Knowledge of Mapping Data Flows, SQL, and Spark for data transformation.
• Experience with incremental data loads, Change Data Capture (CDC), and data validation.
• Ability to troubleshoot and optimize data pipelines for performance and reliability.
• Knowledge of data modelling, data warehousing, and cloud data platform security/governance.
• Experience supporting on-premises data migration to Azure cloud environments.

Responsabilités

• Design, develop, and maintain data pipelines using Azure Data Factory.
• Build and manage enterprise-scale data lakes using Azure Data Lake Storage.
• Develop ETL/ELT workflows to ingest data from databases, APIs, files, and cloud apps.
• Implement data transformation using Mapping Data Flows, SQL, and Spark.
• Monitor, troubleshoot, and optimize pipelines for performance and reliability.
• Configure incremental loads, CDC, and data validation processes.
• Collaborate with analysts and stakeholders to understand data requirements.
• Design data models and support data warehousing solutions.
• Implement security, governance, and access controls for cloud data platforms.
• Create technical docs and maintain data architecture standards.
• Support migration of on-prem data to Azure cloud environments.

Connaissances

Azure Data Factory

Azure Data Lake Storage

ETL/ELT

Mapping Data Flows

SQL

Apache Spark

CDC

Data validation

Data modeling

Data warehousing

Security & governance

On-premise migration

Description du poste

HTC Global Services is seeking an Azure Data Engineer to design and maintain scalable data pipelines on Azure. You will work with Azure Data Factory and Data Lake Storage to ingest, transform, and store data for cloud analytics and warehousing.

The role emphasizes building reliable ETL/ELT workflows, collaborating with stakeholders, and supporting migration of on-premises data to Azure. Strong SQL, Spark, and data modeling skills are required to drive secure, governed data platforms.