Senior Data Engineering Lead — Azure & Databricks

State Street; Burlington (MA); On-site; USD 120,000 - 203,000; Full time

Job summary

State Street is seeking a Data Engineer Lead to design, develop, and maintain Azure-based data pipelines and Delta Lake architectures. You will drive ELT/ETL processes, data modeling, and cloud migration from on-prem to Azure, while collaborating with global teams to ensure data quality and security.

The role emphasizes hands-on development with Databricks, Azure Synapse Analytics, and SQL databases, plus strong communication and governance practices in a large financial services setting.

Qualifications

• Bachelor’s degree in computer or IT related subject.
• 10+ years of overall IT industry experience.
• 8+ years of Bigdata data pipeline experience.
• 8+ years as a Data Engineer focusing on Azure Databricks.

Responsibilities

• Design, develop, and maintain data pipelines in Azure for ingested data into centralized data lakes and Delta Lake.
• Implement ELT/ETL processes to ensure data quality and reliability.
• Design data models and database schemas for structured and unstructured data.
• Collaborate with cross-functional teams to translate data requirements into technical solutions.
• Monitor pipelines, troubleshoot issues, and ensure data integrity and security.

Skills

Azure Data Factory

Azure Databricks

SQL

Big data pipelines

Cloud migration

Education

Bachelor’s Degree in Computer Science

Tools

Azure Synapse Analytics

Azure SQL Database

Snowflake

Git

Job description

State Street is seeking a Data Engineer Lead to design, develop, and maintain Azure-based data pipelines and Delta Lake architectures. You will drive ELT/ETL processes, data modeling, and cloud migration from on-prem to Azure, while collaborating with global teams to ensure data quality and security.

The role emphasizes hands-on development with Databricks, Azure Synapse Analytics, and SQL databases, plus strong communication and governance practices in a large financial services setting.