Senior Azure Data Engineering Lead — Data Lakes & Pipelines

State Street; Boston (MA); Hybrid; USD 120,000 - 203,000; Full time

Benefits offered by this job

401K with company match

Medical/Dental/Vision insurance

Paid time off

Job summary

State Street in Boston is seeking a senior Data Engineer to design, build, and optimize Azure-based data pipelines (Azure Synapse, Data Factory, Databricks) for ingesting, transforming, and storing data with quality and security in mind.

You will collaborate with data scientists and software engineers to implement robust ELT/ETL processes, model data, govern data, and ensure scalable performance while working onsite 4 days a week with one remote day.

Qualifications

• Bachelor's degree in Computer Science or IT field and 10+ years IT experience.
• 8+ years in Big Data pipelines and data engineering on Azure.
• Proficiency in SQL and programming languages (Scala/Java).
• Experience with Azure cloud services and modern data platforms.

Responsibilities

• Design, develop, and maintain Azure data pipelines for ingesting and transforming data.
• Implement ELT/ETL processes to ensure data quality and reliability.
• Model data and optimize database schemas for performance and scalability.
• Collaborate with data scientists, analysts, and engineers on data needs.
• Monitor pipelines, troubleshoot issues, and enforce data governance.

Skills

Azure data engineering

SQL

Scala/Java

Databricks

Azure Synapse Analytics

Azure Data Factory

Azure SQL Database

Snowflake

Git

Problem solving

Communication

Education

Bachelor’s Degree in Computer Science or IT

10+ years IT industry experience

8+ years Bigdata data pipeline

8+ years Data Engineer on Azure Databricks

8+ years cloud development with Azure, DevOps, Kubernetes, Docker

Snowflake experience is plus

Tools

Azure Databricks

Azure Synapse Analytics

Azure Data Factory

Azure SQL Database

Snowflake

Kubernetes

Docker

Git

Job description

State Street in Boston is seeking a senior Data Engineer to design, build, and optimize Azure-based data pipelines (Azure Synapse, Data Factory, Databricks) for ingesting, transforming, and storing data with quality and security in mind.

You will collaborate with data scientists and software engineers to implement robust ELT/ETL processes, model data, govern data, and ensure scalable performance while working onsite 4 days a week with one remote day.