Senior Data Engineering VP — Azure, Databricks & Snowflake

State Street; Quincy (MA); Hybrid; USD 130,000 - 213,000; Full time

Benefits offered by this job

401K match

Medical insurance

PTO

Job summary

State Street is seeking a Data Engineer Lead to design, develop, and optimize data pipelines in Azure, leveraging Databricks, Snowflake, and Delta Lake. You’ll ensure data quality, governance, and secure data access while migrating on-prem applications to cloud-enabled solutions.

The role requires 12+ years in IT with 8+ years in data pipelines and 5+ years focusing on Azure Databricks and Snowflake. Expect onsite heavy work with some flex, and a comprehensive benefits package.

Qualifications

• Bachelor’s degree in a computer/IT field.
• 12+ years of overall IT industry experience.
• 8+ years of data pipeline and data warehousing experience.
• 5+ years as a Data Engineer with Azure Databricks and Snowflake focus.

Responsibilities

• Design, develop, and maintain data pipelines in Azure for ingestion, transformation, and loading into centralized data lakes and Snowflake/Data Warehouse.
• Implement ELT/ETL processes to ensure data quality and reliability across sources.
• Design data models and schemas for structured and unstructured data.
• Optimize data storage and access for performance and scalability.
• Collaborate with data scientists, analysts, and engineers to meet data requirements.
• Monitor pipelines, troubleshoot issues, and ensure data security and governance.

Skills

Azure data engineering

SQL

ETL/ELT

Data modeling

Programming: Scala/Java

Big data concepts

Data governance

Education

Bachelor’s Degree in Computer or IT field

12+ years IT experience

8+ years data pipeline / data warehousing

5+ years Azure Databricks & Snowflake

Tools

Azure Synapse Analytics

Azure Data Factory

Azure Databricks

Azure SQL Database

Snowflake

Databricks Delta Lake

SQL Server

Job description

State Street is seeking a Data Engineer Lead to design, develop, and optimize data pipelines in Azure, leveraging Databricks, Snowflake, and Delta Lake. You’ll ensure data quality, governance, and secure data access while migrating on-prem applications to cloud-enabled solutions.

The role requires 12+ years in IT with 8+ years in data pipelines and 5+ years focusing on Azure Databricks and Snowflake. Expect onsite heavy work with some flex, and a comprehensive benefits package.