Cloud Data Lake Engineer — ETL, Spark & AWS Leader

State Street

Boston (MA)

On-site

USD 90,000 - 158,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

401K match

Healthcare insurance

Paid time off

Job summary

State Street seeks a skilled Data Engineer to design, build, and optimize data infrastructure and analytics initiatives. You will lead hands‑on development of data frameworks, ensuring data integrity, scalability, and security in cloud environments.

Responsibilities include data lake design, ETL/ELT workflows, and building scalable pipelines using Spark, PySpark, Python, and AWS services. Collaboration with data science, analytics, and product teams is essential.

Qualifications

Bachelor’s or Master’s in CS/Engineering/Math or equivalent experience.
5+ years of professional software design and development.
Strong analytical skills and ability to work independently.
Proven ability to work with cross‑functional processes and timelines.
Attention to detail and strong time management.

Responsibilities

Collaborate with data scientists, analysts, and product teams to enable analytics and ML use cases.
Ensure data quality, reliability, security, and governance across platforms.
Optimize performance and cost of data workloads in AWS and Databricks.
Implement CI/CD pipelines and infrastructure as code (Terraform, CloudFormation).
Monitor and resolve data pipeline and platform issues.
Document data architecture, pipelines, and operational processes.
Design & develop Cloud Data Lake end‑to‑end including ingestion and distribution.
Build data integrations across on‑prem and cloud systems.
Develop scalable data pipelines using AWS services and Databricks.