Senior Cloud Data Engineer – AI-Driven Data Pipelines

State Street Investment Management; Boston (MA); On-site; USD 70,000 - 119,000; Full time

Benefits offered by this job

401K with company match

Comprehensive benefits

Paid time off

Employee Assistance Program

Performance-based awards

Job summary

State Street Investment Management is seeking an Officer-level Senior Data Engineer (Cloud & Analytics) in Boston to design and build modern cloud-based data platforms for analytics, reporting, and AI use cases within the CCG and CBO teams.

You will own end-to-end data pipelines, drive production stability, and collaborate with cross-functional stakeholders to translate business requirements into scalable solutions, while following Agile practices and SDLC standards.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 6–10 years of overall IT experience, with strong focus on Data Engineering.
• 4+ years of hands-on experience building data pipelines on cloud platforms.
• Proven experience as a senior data engineer/ETL expert on complex problems.
• Excellent communication and leadership skills.

Responsibilities

• Design, develop, and support end-to-end data pipelines with AWS, Redshift, Databricks, and Snowflake.
• Implement and maintain API integrations and secure authentication mechanisms.
• Build scalable ingestion, transformation, and validation frameworks using Python, SQL, and Shell scripting.
• Develop and optimize data pipelines for performance and quality.
• Collaborate with product owners and analytics teams to translate requirements into solutions.
• Support production stability, incident resolution, and root‑cause analysis.
• Participate in architecture discussions, design reviews, and technical walkthroughs.
• Follow Agile practices with JIRA; manage sprint planning and estimation.
• Ensure data security, governance, and SDLC standards.
• Apply AI code generation tools to accelerate development and productivity.

Skills

AWS data pipelines

Python

SQL

Shell scripting

Airflow

Databricks

Snowflake

Communication

Leadership

Education

Bachelor's/Master's in CS/Engineering

Tools

Databricks

Snowflake

Git/Bitbucket

CI/CD pipelines

Job description

State Street Investment Management is seeking an Officer-level Senior Data Engineer (Cloud & Analytics) in Boston to design and build modern cloud-based data platforms for analytics, reporting, and AI use cases within the CCG and CBO teams.

You will own end-to-end data pipelines, drive production stability, and collaborate with cross-functional stakeholders to translate business requirements into scalable solutions, while following Agile practices and SDLC standards.