Azure Data Engineer - Lakehouse & Pipelines Expert

Northern Trust; Chicago (IL); On-site; USD 115,000 - 195,000; Full time

Benefits offered by this job

Comprehensive benefits

Discretionary bonus program

401k and pension

Job summary

Northern Trust in Chicago is seeking an experienced Azure Data Engineer to design, build, and operate secure cloud data solutions for analytics and reporting. You will join the Corporate Architecture team and translate business needs into production-ready data products using Azure Data Factory, Databricks, and data lake technologies.

The role requires strong Python, PySpark, and SQL skills, hands-on experience with Azure data services, and a focus on scalable, governable data pipelines with

Qualifications

• Proven expertise in designing and operating enterprise-grade data pipelines in Azure.
• Strong hands-on experience with Azure Data Factory, Databricks and Data Lake Gen2.
• Advanced Python, PySpark and SQL skills with performance tuning.
• Experience with ETL/ELT, data modeling, and data quality practices.
• Familiar with CI/CD and infrastructure-as-code approaches.

Responsibilities

• Partner with business, architecture, analytics, security, and engineering stakeholders to translate business needs into data requirements.
• Design and implement scalable batch and near-real-time data pipelines that ingest, transform, validate, and publish data.
• Build cloud-native Azure data solutions using Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Spark, Python, SQL, and related services.
• Develop lakehouse and data warehouse solutions using Bronze, Silver, and Gold patterns with appropriate dimensional modeling.
• Evangelize modern data modeling and data quality practices.
• Develop reusable, metadata-driven frameworks and parameterized pipelines with automated tests in partnership with QA teams.
• Implement CI/CD and infrastructure-as-code practices for repeatable deployment.

Skills

Azure Data Factory

Azure Databricks

Azure Data Lake Storage Gen2

Delta Lake

Python

PySpark

SQL

ETL/ELT patterns

CI/CD

Terraform/Bicep/ARM

Git-based development

Agile delivery

Tools

Azure DevOps

GitHub Actions

Jenkins

Terraform

Bicep

ARM templates

PowerShell

Job description

Northern Trust in Chicago is seeking an experienced Azure Data Engineer to design, build, and operate secure cloud data solutions for analytics and reporting. You will join the Corporate Architecture team and translate business needs into production-ready data products using Azure Data Factory, Databricks, and data lake technologies.

The role requires strong Python, PySpark, and SQL skills, hands-on experience with Azure data services, and a focus on scalable, governable data pipelines with