Data Engineering Lead: Azure, Databricks & Snowflake

STATE STREET CORPORATION; Quincy (MA); On-site; USD 120,000 - 203,000; Full time

Job summary

State Street Corporation seeks a Data Engineer Lead to design, build, and optimize Azure-based data pipelines ingesting data from varied sources into centralized data lakes and Snowflake. You will ensure data quality, implement ELT/ETL processes, and develop scalable models for downstream analytics.

You will collaborate with analysts, software engineers, and operations teams to maintain data integrity, security, and governance while migrating on-prem apps to cloud and supporting cross-system

Qualifications

• 12+ years in IT with data pipeline and data warehousing experience.
• 5+ years designing data solutions on Azure Databricks and Snowflake.
• Strong SQL and programming in Scala or Java; cloud-based development experience.
• Knowledge of RBAC/ABAC and data governance practices.

Responsibilities

• Design, develop, and maintain data pipelines in Azure for ingestion, transformation, and loading into lakehouse and Snowflake.
• Ensure data quality, security, and governance across pipelines and data stores.
• Collaborate with data scientists, analysts, and software engineers to deliver scalable solutions.
• Identify performance bottlenecks and optimize queries, data structures, and infra.
• Lead migration of on-prem apps to cloud and implement ETL/ELT processes.
• Document data flows, architectures, and system configurations.

Skills

Azure Databricks

Azure Data Factory

Snowflake

SQL

Scala

Java

Data modeling

ETL/ELT

Data warehousing

Education

Bachelor’s Degree in a computer or IT-related subject

Tools

Git

SVN

Docker

Kubernetes

Job description

State Street Corporation seeks a Data Engineer Lead to design, build, and optimize Azure-based data pipelines ingesting data from varied sources into centralized data lakes and Snowflake. You will ensure data quality, implement ELT/ETL processes, and develop scalable models for downstream analytics.

You will collaborate with analysts, software engineers, and operations teams to maintain data integrity, security, and governance while migrating on-prem apps to cloud and supporting cross-system