Data Engineering Lead: Azure, Snowflake & Databricks

State Street; Princeton (NJ); Hybrid; USD 130,000 - 213,000; Full time

Benefits offered by this job

401K with company match

Medical, dental, vision insurance

Paid time off (PTO)

Employee Assistance Program

Performance-based incentive

Job summary

State Street is seeking a Data Engineer Lead to architect and optimize Azure-based data pipelines, leveraging Azure Synapse, Databricks, and Snowflake for a hybrid onsite/offsite collaboration in Princeton, NJ. You will drive data quality, governance, and scalable data models while collaborating with cross‑functional teams to deliver robust analytics platforms.

The role requires 12+ years IT experience with 8+ years in data pipelines and data warehousing, and hands-on Azure cloud expertise.

Qualifications

• Must have hands-on experience with Azure services (Synapse, Data Factory, Databricks, Azure SQL Database).
• Strong experience with Snowflake data ingestion pipelines.
• Extensive data engineering experience including ETL/ELT, data modeling and warehouse concepts.
• Proficient in SQL; programming in Scala or Java.
• Knowledge of both relational and non-relational databases; experience with monitoring and governance.

Responsibilities

• Design, develop, and maintain Azure data pipelines for ingestion, transformation, and loading into centralized data lakes, Databricks Delta Lake, and Snowflake.
• Implement efficient ELT/ETL processes and data transformations for clean, enriched data.
• Model databases and schemas for structured and unstructured data, optimizing for performance and scalability.
• Apply modern data processing principles and use pipeline tools to automate ETL tasks.
• Ensure data quality, governance, security, and RBAC/ABAC across systems.
• Collaborate with analysts, data scientists, and engineers to translate data requirements into solutions.
• Monitor pipelines, troubleshoot issues, and enforce data integrity.
• Document data flows and system configurations; stay updated on data engineering trends.

Skills

Azure Data Factory

Azure Synapse Analytics

Azure Databricks

Snowflake

SQL

Scala or Java

RBAC/ABAC

Git/SVN

Data Modeling

Data Warehousing

Education

Bachelor’s Degree in Computer/IT

12+ years IT industry experience

8+ years data pipeline & Data Warehousing

5+ years Data Engineer on Azure Databricks & Snowflake

5+ years cloud-based development (Azure, DevOps, Kubernetes, Docker)

Tools

Azure Synapse Analytics

Azure Data Factory

Azure Databricks

Snowflake

SQL

Scala/Java

Databricks Delta Lake

Job description

State Street is seeking a Data Engineer Lead to architect and optimize Azure-based data pipelines, leveraging Azure Synapse, Databricks, and Snowflake for a hybrid onsite/offsite collaboration in Princeton, NJ. You will drive data quality, governance, and scalable data models while collaborating with cross‑functional teams to deliver robust analytics platforms.

The role requires 12+ years IT experience with 8+ years in data pipelines and data warehousing, and hands-on Azure cloud expertise.