Hybrid Senior Databricks Data Engineer - Azure Cloud

STATE STREET CORPORATION

Quincy (MA)

Hybrid

USD 120,000 - 203,000

Full time

14 days+

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

401K with company match

Health, dental, vision insurance

Paid time off

Employee Assistance Program

Annual incentive compensation

Job summary

State Street Corporation is seeking a senior data platform engineer to design, build and test end-to-end data pipelines on Azure and Databricks. You will implement ETL, support data lakes, and collaborate within an agile team to deliver scalable data solutions in a financial services context.

The role requires 10+ years in Bigdata pipelines with Databricks experience and cloud development with Azure, Kubernetes and Docker. A strong focus on data quality, security and performance is essential.

Qualifications

Bachelor’s Degree in computer or IT related subject.
10+ years of overall Bigdata data pipeline experience.
5+ years of Databricks hands on experience.
5+ years of cloud-based development including Azure Services, Azure Devops, Kubernetes, Docker.
Experience with Snowflake is a plus.

Responsibilities

Design, build and test end to end data pipeline including data ingestion on cloud-based infrastructure using Azure, Cosmos DB
Develop and implement ETL processes for data ingestion, transformation and loading data into data lakes
Work extensively on Databricks and data warehousing concepts
Design & develop custom high throughput and configurable frameworks/libraries
Ability to drive change through collaboration, influence and demonstration of POCs
Responsible for all aspects of SDLC including design, coding, integration testing, deployment, and documentation
Work collaboratively within an agile project team
Follow best practices and coding standards
Grow your personal skillset