Lead, Arch Solutions

Northern Trust Corp; Chicago, Northern (IL, KY); Hybrid; USD 115,000 - 195,000; Full time

Benefits offered by this job

retirement benefits (401k and pension)

health and welfare benefits (medical,

paid time off

parental and caregiver leave

life & accident insurance

other voluntary and well-being

Job summary

Northern Trust is seeking an experienced Azure Data Engineer to design, build, and operate secure, scalable cloud data solutions. You will work within the Corporate Architecture team to translate business requirements into production-ready data products for analytics and reporting.

You will leverage Azure Data Factory, Databricks, Data Lake Gen2, Spark, Python, and SQL to implement lakehouse and data warehouse patterns, with strong emphasis on data governance and CI/CD practices.

Qualifications

• Proven experience designing enterprise-grade data pipelines and analytics platforms in Azure.
• Hands-on with Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Delta Lake.
• Advanced Python, PySpark, and SQL skills including performance tuning.
• Strong knowledge of ETL/ELT, distributed data processing, orchestration, and schema evolution.
• Experience modeling relational, dimensional, and lakehouse structures (star schemas, conformed dimensions).
• Experience with relational, analytical, columnar, and NoSQL platforms (Oracle, PostgreSQL, Azure SQL, Snowflake).
• Experience with Git-based development, automated testing, and CI/CD using Azure DevOps, GitHub Actions, Jenkins, or equivalent.

Responsibilities

• Partner with business, architecture, analytics, security, and engineering stakeholders to translate business needs into data requirements.
• Design scalable batch and near-real-time data pipelines for structured and unstructured data.
• Build cloud-native Azure data solutions using ADP, Databricks, Data Lake Gen2, Spark, Python, SQL.
• Develop lakehouse and data warehouse patterns with Bronze, Silver, and Gold layers and appropriate modeling.
• Champion modern data modeling and data quality practices.
• Create reusable, metadata-driven pipelines and tests in collaboration with QA teams.
• Implement CI/CD and IaC for repeatable deployments across environments.

Skills

Azure Data Factory

Azure Databricks

Azure Data Lake Storage Gen2

Delta Lake

Python

PySpark

SQL

ETL/ELT patterns

Data modeling (lakehouse)

CI/CD

Git-based development

Tools

Azure DevOps

GitHub Actions

Jenkins

Terraform

Bicep / ARM templates

Job description

About Northern Trust

As a global leader in innovative wealth management, asset servicing, asset management and banking services, Northern Trust (Nasdaq: NTRS) is proud to guide the world’s most successful individuals, families, corporations and institutions. Since 1889, we have aligned our efforts with our three guiding Principles That Endure: Service, Expertise, and Integrity. Together, they reflect the three cornerstones of business conduct which we strive to instill in our employees, whom we call partners, and to provide to our clients and the communities we serve worldwide. With more than 135 years of financial experience and over 24,000 partners, we serve the world’s most sophisticated clients using leading technology and exceptional service.

Job Description

We are seeking an experienced Azure Data Engineer to design, build, and operate secure, scalable, and reliable cloud data solutions across Corporate Services. As a key member of the Corporate Architecture team, this role will translate business requirements into production-ready data products that support analytics, reporting, and advanced data use cases. The successful candidate will combine strong software engineering and data architecture skills with hands‑on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Spark, Python, and SQL. The role will contribute to the modernization of legacy data platforms through reusable engineering patterns, automated delivery, strong data governance, and operational excellence.

Responsibilities

• Partner with business, architecture, analytics, security, and engineering stakeholders to translate business needs into clear functional and non-functional data requirements.
• Design and implement scalable batch and near-real-time data pipelines that ingest, transform, validate, and publish structured and unstructured data.
• Build cloud-native Azure data solutions using Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Spark, Python, SQL, and related services.
• Develop lakehouse and data warehouse solutions using layered data patterns such as Bronze, Silver, and Gold, with appropriate dimensional, normalized, or Data Vault modeling techniques.
• Evangelize modern data modeling and data quality practices.
• Develop reusable, metadata-driven frameworks and parameterized pipelines that reduce duplication and improve delivery consistency.
• Build automated unit, integration, regression, and data-validation tests in partnership with quality-engineering teams.
• Implement CI/CD and infrastructure-as-code practices for repeatable deployment across development, test, and production environments.

Required Skills

• Proven expertise in designing, developing, and supporting enterprise-grade data pipelines and analytics platforms in Azure.
• Strong hands‑on experience with Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Delta Lake.
• Advanced proficiency in Python, PySpark, and SQL, including performance tuning and development of reusable data-processing components.
• Strong understanding of ETL and ELT patterns, distributed data processing, orchestration, incremental loading, change data capture, and schema evolution.
• Experience building relational, dimensional, and lakehouse data models, including star schemas and conformed dimensions.
• Hands‑on experience with relational, analytical, columnar, and NoSQL technologies such as Oracle, PostgreSQL, Azure SQL, Snowflake, or equivalent platforms.
• Experience with Git-based development, automated testing, and CI/CD using Azure DevOps, GitHub Actions, Jenkins, or equivalent tools.
• Familiarity with infrastructure-as-code and deployment automation using Terraform, Bicep, ARM templates, or similar technologies.
• Experience working in Agile delivery environments and participating in estimation, design reviews, code reviews, release planning, and production support.

Salary Range

$114,500 - 194,700 USD salary range is a good faith estimate of base pay.

Benefits

• retirement benefits (401k and pension)
• health and welfare benefits (medical, dental, vision, spending accounts and disability)
• paid time off
• parental and caregiver leave
• life & accident insurance
• other voluntary and well-being benefits

Northern Trust also provides a discretionary bonus program that may include an equity component.

Work Authorization

Applicants must be authorized to work in the U.S. without the need for employment‑based visa sponsorship now or in the future. Northern Trust will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa).

Working with Us

As a Northern Trust partner, you will be part of a flexible and collaborative work culture, which has a strong history of financial strength and stability. Movement within the organization is encouraged, senior leaders are accessible, and you can take pride in working for a company committed to an inclusive workplace and assisting the communities we serve. Philanthropy is deeply rooted in Northern Trust’s history and is an essential element of our culture. Employees around the world give their time and talent to work for the greater good of their communities.

Reasonable Accommodation

Northern Trust is committed to working with and providing adjustments to individuals with health conditions and disabilities. If you need a reasonable accommodation for any part of the employment process, please email our HR Service Center at [e-mail], or alternatively you can discuss your individual requirements with the recruiter you are working with.

Looking for greater?

You found it. A global financial leader with more than 22,000 employees in 23 locations worldwide, Northern Trust empowers our employees to achieve more than just business goals. Our focus on work‑life balance, career mobility and unique opportunities are just a few of the reasons we’ve been named one of the world’s most admired companies.

Terms and Conditions

Candidate Privacy Notice California Applicant Privacy Notice Pay Transparency Nondiscrimination Provision (U.S) Transparency in Coverage Disclosure – North America Northern Trust is committed to working with and providing reasonable accommodations to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the employment process, please email our HR Service Center or call 1-800-807-0302 (North America), [phone] (Asia Pacific), 1800-425-0333 (India), [phone] (Europe, Middle East and Africa) and let us know the nature of your request and your contact information.

APAC/INDIA EEO STATEMENT

It is the policy and practice of Northern Trust to provide equal employment opportunities to all employees and applicants. Northern Trust does not discriminate on the basis of race, colour, religion or belief, nationality, ethnic or national origin, sex, marital status, sexual orientation, disability or age. All employment decisions will be made in a non‑discriminatory manner in accordance with our obligations under the law and codes of practice. This includes human resources’ decisions relating to recruitment, terms and conditions of employment, transfers, promotions and access to learning and development.

Canada EEO STATEMENT

Northern Trust is an Equal Opportunity Employer. Hiring and other employment decisions at Northern Trust are made without regard to race, colour, religion, sex, ancestry, national origin, ethnic origin, age, disability, citizenship, veteran status, sexual orientation, record of offences, marital status, family status, or any other characteristic protected by federal, provincial, or local law, regulation, or ordinance.

EMEA EEO STATEMENT

It is the policy and practice of Northern Trust to provide equal employment opportunities to all employees and applicants. Northern Trust does not discriminate on the basis of race, colour, religion or belief, nationality, ethnic or national origin, sex, marital status, sexual orientation, disability or age. All employment decisions will be made in a non‑discriminatory manner in accordance with our obligations under the law and codes of practice. This includes human resources’ decisions relating to recruitment, terms and conditions of employment, transfers, promotions and access to learning and development.

USA EEO STATEMENT

It is the policy of The Northern Trust Company to afford equal opportunity in all phases of employment without regard to an individual’s age, race, color, religion, creed, gender, national origin, citizenship status, marital status, pregnancy, sexual orientation, gender identity, gender expression, genetic tests and information, physical or mental disability, protected veteran status or any other legally protected status. EEO Know Your Rights (U.S.)