Senior Data Engineer: Cloud Lakehouse & AI Pipelines

STATE STREET CORPORATION; Quincy (MA); On-site; USD 70,000 - 119,000; Full time

Benefits offered by this job

401K with company match

Comprehensive benefits package

Paid time off

Job summary

State Street Corporation seeks a Data Engineer - Officer for the Data, Analytics & AI Services team in Massachusetts. You will design, develop, and maintain large-scale data pipelines using Python, PySpark, SQL, and cloud-native technologies on AWS, Databricks, and Snowflake, contributing to our modern data platform.

The role focuses on building robust data ingestion and transformation workflows, implementing CI/CD with Jenkins, Artifactory, and GitHub, containerising APIs and streaming

Qualifications

• Master’s degree in Computer Science or related engineering field.
• 6–10 years of technology experience with data engineering focus.
• Strong hands-on in Python, Spark, SQL, Databricks and Snowflake on AWS.
• Experience building Lakehouse platforms and cloud-native analytics.
• Proficiency in CI/CD, automation, and observability.

Responsibilities

• Design, develop, test, and maintain data pipelines using Python, PySpark, and SQL.
• Build and manage data ingestion and transformation workflows with Databricks and Snowflake.
• Develop containerised applications for APIs, streaming and batch workloads with Docker.
• Implement CI/CD pipelines using Jenkins, Artifactory, GitHub.
• Collaborate with product owners and analytics teams to translate business needs.

Skills

Python

PySpark

SQL

Data pipelines

Agile practices

Communication

Education

Master’s degree in Computer Science

Tools

Databricks

Snowflake

AWS

Jenkins

Artifactory

GitHub

Docker

Job description

State Street Corporation seeks a Data Engineer - Officer for the Data, Analytics & AI Services team in Massachusetts. You will design, develop, and maintain large-scale data pipelines using Python, PySpark, SQL, and cloud-native technologies on AWS, Databricks, and Snowflake, contributing to our modern data platform.

The role focuses on building robust data ingestion and transformation workflows, implementing CI/CD with Jenkins, Artifactory, and GitHub, containerising APIs and streaming