Data Engineer - Manager

State Street; Bengaluru; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

State Street is seeking a Data Engineer in Bengaluru to design and maintain scalable batch ETL pipelines using Python and Apache Spark. You will build data solutions on Databricks (AWS), develop SQL-based transformations, and implement data models to support analytics across enterprise platforms.

The role emphasizes data quality, performance, and reliability in cloud data environments, partnering with analysts and technology teams in a financial services context.

Qualifications

• 7-9 years of data engineering experience with cloud/data warehousing focus.
• Strong experience with cloud data engineering and big data technologies.
• Solid understanding of data warehousing and data modeling concepts.

Responsibilities

• Design and develop batch ETL pipelines using Python and Apache Spark.
• Build and optimize data solutions on Databricks (AWS).
• Develop and maintain SQL-based transformations and data validation logic.
• Implement efficient data models to support downstream analytics.
• Ensure data quality, performance, and reliability in cloud data platforms.
• Collaborate with analysts and technology teams to deliver data solutions.

Skills

Python

Apache Spark

Databricks on AWS

SQL

Data Warehousing

Job description

Role: Data Engineer

State Street Investment Management is seeking a Data Engineer with strong expertise in Python, Apache Spark, Databricks, and AWS to support cloud-based data engineering initiatives. The role focuses on building and maintaining scalable batch ETL pipelines and well-structured data models to support analytics and reporting platforms.

Key Responsibilities

• Design and develop batch ETL pipelines using Python and Apache Spark
• Build and optimize data solutions on Databricks (AWS)
• Develop and maintain SQL-based transformations and data validation logic
• Implement efficient data models to support downstream analytics
• Ensure data quality, performance, and reliability in cloud data platforms
• Collaborate with analysts and technology teams to deliver data solutions

Required Experience

• 7-9 years of experience in data engineering
• Strong experience with cloud data engineering and big data technologies
• Solid understanding of data warehousing and data modeling concepts
• Experience working in large enterprise environments (financial services preferred)

Must-Have Skills

• Python
• Apache Spark
• Databricks on AWS
• SQL
• Data Warehousing

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

Job ID: R-793320