Data Engineer, Data Quality and Governance(VP)

State Street Corporation; London; On-site; GBP 70,000 - 100,000; Full time

Job summary

A leading financial services company is seeking a Data Engineer to support Cloud Data Lake activities. This hands-on role involves designing and developing cloud infrastructure while ensuring data governance and compliance. Ideal candidates will have extensive experience in data engineering and cloud applications, particularly within high-volume data processing frameworks.

Qualifications

• 12+ years of professional experience in software design and development.
• Strong analytical skills with the ability to quickly absorb and analyze information independently.
• Proven ability to develop and work with cross-functional processes and project timelines.

Responsibilities

• End-to-end Cloud Data Lake design & development, including data ingestion, modeling, and distribution.
• Building data integrations between on-premises and cloud-based systems.
• Ensuring cloud solutions exhibit high levels of cost efficiency, performance, security, scalability, and reliability.

Skills

Data (Delta Lake/DataBricks)

PL/SQL

Java/J2EE

React

CI/CD pipeline

Python

Scala/PySpark

PERL/scripting

Education

Bachelor's or Master's Degree in Computer Science, Engineering, Math

Job description

We are looking for a Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud-based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects, and business leadership to develop and execute the technology product roadmap and drive Data Governance policy implementation.

What you will be responsible for

• End-to-end Cloud Data Lake design & development, including data ingestion, data modeling, and data distribution.
• Building data integrations and hand-offs between on-premises and cloud-based systems.
• Developing and implementing cloud infrastructure to support current and future business needs.
• Participating in technical design, application build, configuration, unit testing, and production deployment.
• Ensuring all cloud solutions exhibit high levels of cost efficiency, performance, security, scalability, and reliability.
• Managing offshore and onshore teams spread globally.

What we value

These skills will help you succeed in this role:

• Full stack cloud developer skills: Data (Delta Lake/DataBricks), PL/SQL, Java/J2EE, React, CI/CD pipeline, and release management.
• Strong skills and experience in Python, Scala/PySpark, PL/SQL, PERL/scripting.
• Experience as a Data Engineer for Cloud Data Lake activities, with industry experience (preferably in Financial Services) in building enterprise Cloud applications based on high-volume data processing frameworks, ETL development using distributed computing frameworks like Apache Spark, Hadoop, Hive.
• Experience with optimizing database performance, scalability, and ensuring data security and compliance.
• Experience with event-based, micro-batch, and batched high-volume and high-velocity transaction and data processing systems.
• Proficiency with CI/CD and DevOps practices.

Education & Preferred Qualifications

• Bachelor's or Master's Degree in Computer Science, Engineering, Math, or equivalent experience.
• 12+ years of professional experience in software design and development.
• Strong analytical skills with the ability to quickly absorb and analyze information independently.
• Proven ability to develop and work with cross-functional processes and project timelines.
• Excellent follow-through, attention to detail, and time management skills.
• Ability to manage multiple tasks simultaneously in a high-pressure, deadline-driven environment.