Azure Data Engineer

MSR Technology Group; Springfield (IL); Remote; USD 120,000 - 170,000; Full time

Job summary

MSR Technology Group is seeking a hands-on Senior Azure Data Engineer to support a large-scale Enterprise Data Warehouse modernization. You will design scalable Azure data pipelines and modernize legacy ETL environments to support analytics, reporting, dashboards, and AI/ML use cases.

Ideal candidates will have strong Databricks, PySpark, SQL, ADLS Gen2, Delta Lake, and Azure Synapse experience, with migrations from Informatica PowerCenter to Azure.

Qualifications

• Strong Databricks and PySpark experience.
• Advanced SQL development and performance tuning.
• Experience with ADLS Gen2 and Delta Lake.
• Experience with Azure Synapse, Azure Databricks and/or Microsoft Fabric.
• Experience building enterprise ETL/ELT pipelines.
• Experience with Azure DevOps and CI/CD.
• Experience with modern Lakehouse architecture.

Responsibilities

• Design and develop ETL/ELT pipelines using Azure Data Factory, Databricks, Synapse and/or Microsoft Fabric.
• Develop and optimize PySpark notebooks and Python-based data processing solutions.
• Implement modern Lakehouse and Medallion architectures using ADLS Gen2, Delta Lake and Parquet.
• Develop and optimize complex SQL for large enterprise data environments.
• Support dimensional modeling, Data Vault, SCD and CDC patterns.
• Support legacy-to-cloud modernization, including Informatica PowerCenter to Azure Data Factory migrations.
• Troubleshoot and support critical production data pipelines.

Skills

Databricks

PySpark

SQL

ADLS Gen2

Delta Lake

Azure Synapse

Microsoft Fabric

ETL/ELT pipelines

Azure DevOps

CI/CD

Lakehouse Architecture

Job description

Remote | Enterprise Data Warehouse / ETL Modernization

No third-party vendors or C2C submissions.

Candidates must be authorized to work in the United States without current or future sponsorship.

Candidates within a commutable distance to Springfield, Il preferred.

Position Summary

We are seeking a hands-on Senior Azure Data Engineer to support a large-scale Enterprise Data Warehouse modernization initiative. This role will focus on designing and building scalable Azure data pipelines, modernizing legacy ETL environments, and developing cloud-based data solutions supporting analytics, regulatory reporting, operational dashboards, and emerging AI/ML use cases.

The ideal candidate will have strong hands-on experience with Azure Data Factory, Databricks, PySpark, Python, advanced SQL, Azure Data Lake Storage Gen2, and modern Lakehouse architecture. Experience modernizing Informatica PowerCenter and other legacy data warehouse environments into Azure is highly valuable.

Key Responsibilities

• Design and develop ETL/ELT pipelines using Azure Data Factory, Databricks, Synapse and/or Microsoft Fabric.
• Develop and optimize PySpark notebooks and Python-based data processing solutions.
• Implement modern Lakehouse and Medallion architectures using ADLS Gen2, Delta Lake and Parquet.
• Develop and optimize complex SQL for large enterprise data environments.
• Support dimensional modeling, Data Vault, SCD and CDC patterns.
• Support legacy-to-cloud modernization, including Informatica PowerCenter to Azure Data Factory migrations.
• Troubleshoot and support critical production data pipelines.

Required Qualifications

• Strong Databricks and PySpark experience.
• Advanced SQL development and performance-tuning skills.
• Experience with ADLS Gen2 and Delta Lake.
• Experience with Azure Synapse, Azure Databricks and/or Microsoft Fabric.
• Experience building enterprise ETL/ELT pipelines.
• Experience with Azure DevOps and CI/CD.
• Experience with modern Lakehouse architecture.

Preferred Qualifications

• 5+ years of data warehouse development experience.
• 5+ years of data modeling experience using ERWIN or similar tools.
• 2+ years of Azure Data Factory and Snowflake experience.
• Teradata, Oracle and/or SQL Server experience.
• Healthcare or Medicaid experience is a plus.

Work Arrangement

• Remote within the continental U.S.
• Occasional travel to Springfield, IL, approximately 2–3 times per year.