Data Engineer - Cloud & Analytics, Officer - State Street Investment Management

State Street; Quincy (MA); On-site; USD 70,000 - 119,000; Full time

Job summary

State Street in Massachusetts is seeking an experienced Officer-level Senior Data Engineer to design, build, and support cloud‑based data platforms for analytics, reporting, and AI use cases. You will work hands‑on with AWS, Redshift, Databricks, and Snowflake to create scalable data pipelines.

In this senior role you’ll own technical components, collaborate with cross‑functional teams, and drive production stability and data quality within an Agile environment.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 6–10 years of overall IT experience, with strong focus on Data Engineering.
• 4+ years of hands-on experience building data pipelines on cloud platforms.
• Proven experience as a senior data engineer/ETL expert.
• Excellent communication and leadership skills.

Responsibilities

• Design, develop, and support end-to-end data pipelines using cloud-based platforms such as AWS, Redshift, Databricks, and Snowflake.
• Build scalable ingestion, transformation, and validation frameworks with Python, SQL, and Shell scripting.
• Develop and optimize data pipelines for performance, reliability, and data quality.
• Collaborate with product owners, analytics teams, and downstream consumers to translate business requirements into technical solutions.
• Support production stability, incident resolution, and root-cause analysis for data platforms.
• Participate in architecture discussions, design reviews, and technical walkthroughs.
• Follow Agile delivery practices using JIRA; contribute to sprint planning and estimation.
• Ensure compliance with data security, governance, and SDLC standards.
• Identify opportunities to improve efficiency, automation, and platform capability.

Skills

AWS Cloud

AWS S3

Redshift

Databricks

Snowflake

Python

SQL

Shell scripting

Apache Airflow

Data Warehousing

Data Lakes

Data Quality

GIT

CI/CD

Agile

Leadership

Communication

Education

Bachelor’s or Master’s in CS/Engineering

Tools

Databricks

Snowflake

JIRA

Git

Bitbucket

CI/CD tooling

Job description

We are seeking an experienced Officer‑level Senior Data Engineer to design, build, and support modern cloud‑based data engineering solutions that enable analytics, reporting, and AI use cases for Sales and Business teams. This role focuses on hands‑on engineering with AWS Cloud,Redshift, Databricks, Snowflake, and modern data pipelines, ensuring high‑quality, secure, and scalable data platforms.

The role requires strong ownership of technical components, independence in execution, and close collaboration with cross‑functional stakeholders while operating as a senior individual contributor.

Job Description

Key Responsibilities & Experience Range

• Design, develop, and support end‑to‑end data pipelines using cloud‑based platforms such as AWS, Redshift ,Databricks, and Snowflake.
• Build scalable data ingestion, transformation, and validation frameworks using Python, SQL, and Shell scripting
• Develop and optimize data pipelines for performance, reliability, and data quality
• Partner with product owners, analytics teams, and downstream consumers to translate business requirements into technical solutions
• Support production stability, incident resolution, and root‑cause analysis for data platforms
• Actively participate in architecture discussions, design reviews, and technical walkthroughs
• Follow Agile delivery practices, including sprint planning, estimation, and issue tracking using JIRA
• Ensure compliance with data security, governance, and SDLC standards
• Continuously identify opportunities to improve efficiency, automation, and platform capability
• Good Analytical skills to understand the business requirements and translate them into Technical specifications
• Good hands‑on to AWS Data storage products like AWS S3 and Amazon Redshift.
• Ability to participate in major incident management, production stability, etc as and when required
• Good Exposure to code versioning tool GIT, Bitbucket and CI/CD Process and project collaboration platform JIRA
• Excellent verbal and written communication and should be able to work with all the stakeholders.
• Prior experience on working in Agile project management practices

Qualification & Certifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 6–10 years of overall IT experience, with strong focus on Data Engineering
• 4+ years of hands‑on experience building data pipelines on cloud platforms
• Proven experience working as a senior data engineer/ETL expert on complex technical problem statements
• Excellent communication and leadership skills.

Primary Skills (Must Have)

• Proficient on designing ,developing and supporting Data pipelines with AWS S3,AWS Redshift, YAML Sripting ,Apache Airflow and Shell Scripting.
• Solid AWS Cloud experience, including EC2, S3, IAM, and cloud‑based data architectures
• Proficiency in Python for data engineering and automation
• Strong SQL skills for data analysis, validation, and performance tuning
• Experience writing and maintaining Shell scripts for automation and operational support
• Good understanding of Data Warehousing, Data Lakes, and Data Quality concepts
• Ability to independently analyze requirements and deliver technical solutions

Secondary Skills (Good to Have)

• Exposure on AWS Cloud Tech Stack for Data Engineering.
• Good to have hands on Databricks and Snowflake.
• Exposure to any financial/asset management domain or sales and marketing would be added advantage.
• Knowledge of networking fundamentals and key management services
• Exposure to Complete CI/CD Process for Deployment and Releases.
• Good understanding/hands-on of application of AI /ML in data engineering and data quality.

Salary Range:

$70,000 - $118,750 Annual

The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.

Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

For a full overview, visit https://hrportal.ehr.com/statestreet/Home.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

Job Application Disclosure:

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.