Azure Data Engineer: Cloud Data Lakes & Pipelines

HTC Global; Grand Rapids (MI); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Hybrid flexibility

Work-Life Balance

Career development plan

Rewards & Recognition

Upskilling opportunities

Emerging technologies experience

Career mobility

Job summary

HTC Global Services is seeking a data engineer to design, build, and maintain cloud-based data pipelines and data lakes on Microsoft Azure. You will implement ETL/ELT workflows, transform data with Spark and SQL, and ensure data quality and security across enterprise-scale pipelines.

The role emphasizes incremental loads, CDC, governance, and collaboration with analysts and stakeholders to meet data requirements and enable cloud analytics and warehousing initiatives.

Qualifications

• Expertise in Azure Data Factory for data pipeline development and maintenance
• Experience with Azure Data Lake Storage and enterprise-scale data lakes
• Experience developing ETL/ELT workflows for data ingestion from multiple sources
• Knowledge of Mapping Data Flows, SQL, and Spark technologies for data transformation
• Experience with incremental data loads, Change Data Capture (CDC), and data validation
• Ability to troubleshoot and optimize data pipelines for performance and reliability
• Knowledge of data modeling, data warehousing, and cloud data platform security and governance
• Experience supporting on-premises data migration to Azure cloud environments

Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory
• Build and manage enterprise-scale data lakes using Azure Data Lake Storage
• Develop ETL/ELT workflows to ingest data from multiple sources, including databases, APIs, flat files, and cloud applications
• Implement data transformation processes using Mapping Data Flows, SQL, and Spark technologies
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability
• Configure incremental data loads, Change Data Capture (CDC), and data validation processes
• Collaborate with data analysts, business stakeholders, and development teams to understand data requirements
• Design data models and support data warehousing solutions
• Implement security, governance, and access controls for cloud data platforms
• Create technical documentation and maintain data architecture standards
• Support the migration of on-premises data solutions to Azure cloud environments

Skills

Data engineering

Cloud data platforms security and治理

CDC

Data modeling

ETL/ELT

Data warehousing

Tools

Azure Data Factory

Azure Data Lake Storage

Mapping Data Flows

SQL

Spark

Job description

HTC Global Services is seeking a data engineer to design, build, and maintain cloud-based data pipelines and data lakes on Microsoft Azure. You will implement ETL/ELT workflows, transform data with Spark and SQL, and ensure data quality and security across enterprise-scale pipelines.

The role emphasizes incremental loads, CDC, governance, and collaboration with analysts and stakeholders to meet data requirements and enable cloud analytics and warehousing initiatives.