Data Engineer - Assistant Vice President

State Street; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

State Street is seeking a Data Engineer in Bengaluru to design, implement, and maintain a secure, scalable data platform spanning AWS, Azure and on-prem data centers. You will own SLA delivery, monitor system KPIs, and contribute to data lake and data warehouse initiatives with a focus on reliability and privacy.

The role requires hands-on Databricks experience, Hadoop and Scala expertise, and strong Python/SQL skills.

Qualifications

• Proficiency in Python, Scala or SQL for data engineering tasks.
• Hands-on Databricks experience is required.
• Experience with Hadoop and data analytics workflows.
• Excellent written and verbal communication skills.

Responsibilities

• Collaborate across teams to enable the Data Platform across cloud and data centers.
• Own and monitor SLA performance and KPIs for data systems.
• Work on data lake, warehouse, and stream processing for unified analytics.
• Design high availability, throughput, data security and privacy features.
• Mentor engineers and promote best practices in monitoring and reliability.
• Scale data systems to meet diverse business needs in a consultative environment.
• Demonstrate knowledge of AWS/Azure/GCP and data analytics end-to-end workflows.
• Hands-on Databricks experience and strong time management are essential.
• Bonus: knowledge of Data Science and ML model deployment.

Skills

Python

Scala

SQL

Databricks

Cloud platforms (AWS/Azure/GCP)

Communication

Time management

Data analytics workflow

Tools

Hadoop

Job description

• Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center
• Own and ensure that internal and external SLA’s meet and exceed expectations, System centric KPIs are continuously monitored
• Work on our data lake, data warehouse, and stream processing systems to create a unified query engine, multi-model databases, analytics extracts and reports, as well as dashboard and visualizations
• Design and build systems for high availability, high throughput, data consistency, security, and end user privacy, defining our next generation of data analytics tooling
• You will mentor other engineers and promote software engineering best practices across the organization designing systems with monitoring, auditing, reliability, and security at their core
• Come up with solutions for scaling data systems for various business needs and collaborate in a dynamic and consultative environment
• Knowledge of at least one of the public cloud platforms AWS, Azure, or GCP is required.
• Knowledge of a programming language - Python, Scala, or SQL
• Knowledge of end-to-end data analytics workflow
• Hands‑on professional experience in Databricks
• Excellent time management and prioritization skills
• Bonus - Knowledge of Data Science and Machine Learning (e.g., build and deploy ML Models)

As Data Engineer you will

• Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center
• Own and ensure that internal and external SLA’s meet and exceed expectations, System centric KPIs are continuously monitored
• Work on our data lake, data warehouse, and stream processing systems to create a unified query engine, multi-model databases, analytics extracts and reports, as well as dashboard and visualizations
• Design and build systems for high availability, high throughput, data consistency, security, and end user privacy, defining our next generation of data analytics tooling
• You will mentor other engineers and promote software engineering best practices across the organization designing systems with monitoring, auditing, reliability, and security at their core
• Come up with solutions for scaling data systems for various business needs and collaborate in a dynamic and consultative environment
• Knowledge of at least one of the public cloud platforms AWS, Azure, or GCP is required.
• Knowledge of a programming language - Python, Scala, or SQL
• Knowledge of end-to-end data analytics workflow
• Hands‑on professional experience in Databricks
• Excellent time management and prioritization skills
• Excellent written and verbal communication
• Bonus - Knowledge of Data Science and Machine Learning (e.g., build and deploy ML Models)

Core/Must Have Skills

• Knowledge of at least one of the public cloud platforms AWS or Azure is required.
• Minimum 5+ years of Databricks experience using Azure Cloud
• 5+ years of hands on expertise in Hadoop and Scala
• Practical experience with Data Engineering and the accompanying DevOps & DataOps workflows
• Knowledge of a programming language - Python, Scala, or SQL
• Knowledge of end-to-end data analytics workflow
• Hands‑on professional experience in Databricks
• Excellent time management and prioritization skills
• Excellent written and verbal communication
• Bonus - Knowledge of Data Science and Machine Learning (e.g., build and deploy ML Models)
• Strong end-to-end ownership and a good sense of urgency to enable proper self-prioritization

Good To Have Skills

• Certification on Azure/AWS
• Certification on Hadoop, Scala and Databricks
• Familiarity with SDLC and Agile methodologies

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work‑life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

Job ID: R-783589