Data Engineer, Data Quality and Governance(VP)

ZipRecruiter; London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading company is seeking a Data Engineer to support Cloud Data Lake activities. The role involves end-to-end design, development, and implementation of cloud infrastructure. Ideal candidates will have extensive experience in Financial Services and strong skills in data engineering, cloud platforms, and team management.

Qualifications

• 12+ years of professional experience in software design and development.
• Experience with managing offshore and onshore teams.

Responsibilities

• End-to-end Cloud Data Lake design & development including data ingestion.
• Build data integrations between on-premises and cloud-based systems.
• Ensure all cloud solutions exhibit high levels of performance and security.

Skills

Cloud Developer

Python

Scala

Data Engineering

DevOps

Education

Bachelor's or Master's Degree in Computer Science

Tools

Apache Spark

Hadoop

Hive

Job description

Job Description

This job is with State Street, an inclusive employer and a member of myGwork – the largest global platform for the + business community. Please do not contact the recruiter directly.

We are looking for a Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud-based Data Engineering platforms. This hands-on role will partner with senior-level development managers, architects, and business leadership to develop and execute the technology product roadmap in driving Data Governance policy implementation.

The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud-based engineering platforms.

What you will be responsible for

• End-to-end Cloud Data Lake design & development including data ingestion, data modeling, and data distribution.
• Build data integrations and hand-offs between on-premises and cloud-based systems.
• Responsible for developing and implementing cloud infrastructure to support current and future business needs.
• Participate in technical design, application build, configuration, unit testing, and production deployment.
• Ensure all cloud solutions exhibit high levels of cost efficiency, performance, security, scalability, and reliability.
• Experience with managing offshore and onshore teams spread globally.

What we value

These skills will help you succeed in this role

• Full-stack cloud developer skills: Data (Delta Lake/DataBricks), PL/SQL, Java/J2EE, React, CI/CD pipeline, and release management.
• Strong skills and experience in Python, Scala/PySpark, PL/SQL, PERL/scripting.
• Skilled Data Engineer for Cloud Data Lake activities, with industry experience (preferably in Financial Services) in building enterprise Cloud applications based on high-volume data processing frameworks, ETL development using distributed computing frameworks such as Apache Spark, Hadoop, Hive.
• Experience with optimizing database performance, scalability, and ensuring data security and compliance.
• Experience with event-based, micro-batch, and batched high-volume and high-velocity transaction and data processing systems.
• Proficiency with CI/CD and DevOps practices.

Education & Qualifications

• Bachelor's or Master's Degree in Computer Science, Engineering, Math, or equivalent experience.
• 12+ years of professional experience in software design and development.
• Strong analytical skills with the ability to quickly and independently analyze information.
• Proven ability to develop and work with cross-functional processes and project timelines.
• Excellent follow-through, attention to detail, and time management skills.
• Ability to manage multiple tasks in a high-pressure, deadline-driven environment.

State Street's Speak Up Line

#LI-DNI