Data Lakehouse Developer

TN United Kingdom; London; On-site; GBP 50,000 - 90,000; Full time

Job summary

An innovative firm is on the lookout for a skilled Data Engineer to join their dynamic team. This role involves designing and building efficient data pipelines, performing ETL operations, and managing databases using cutting-edge AWS services. The ideal candidate will have a strong background in data engineering, with proficiency in SQL and experience with big data technologies. This is an exciting opportunity to contribute to a mission-driven organization focused on transforming the financial services industry through technology. If you are passionate about data and eager to make a significant impact, we want to hear from you!

Qualifications

• 3+ years of experience in data engineering roles.
• Strong proficiency in SQL and ETL processes.
• Hands-on experience with AWS for data processing.

Responsibilities

• Design and maintain scalable data pipelines for processing and analysis.
• Develop ETL processes to ensure data quality and integrity.
• Collaborate with teams to deploy and troubleshoot data systems.

Skills

SQL

ETL processes

Database management

AWS services

Python

Java

Data warehousing

Big data technologies

Education

Bachelor's degree in computer science

Tools

MySQL

PostgreSQL

MongoDB

AWS S3

AWS Redshift

AWS EMR

AWS Glue

Hadoop

Spark

Job description

Social network you want to login/join with:

ZILO is focused on transforming global transfer agency by providing a single global solution that replaces legacy technology and systems. Our mission is to create sustainable value for firms and the customers they serve, all while putting people first. With a design-driven approach and a commitment to innovation, our team of experts has unified the full breadth of global transfer agency into a single, streamlined solution.

At ZILO, we value collaboration, innovation, and continuous improvement. Our team of experienced professionals is dedicated to achieving our goal of being the market-leading solution in global transfer agency. If you are a motivated individual with a passion for technology and a desire to make a real impact in the financial services industry, we would love to hear from you.

About this role

We are seeking a skilled Data Engineer – Data Lakehouse to join our team. The ideal candidate should be experienced in designing and building data pipelines, performing ETL operations, and managing databases. The candidate will also need to have knowledge and experience in using AWS services for data processing, storage, and analysis.

Requirements

Responsibilities

• Design, build and maintain efficient and scalable data pipelines to support data processing and analysis.
• Develop and implement ETL processes to ensure data quality and integrity.
• Manage and optimize databases, including designing schema and indexing strategies, data partitioning, and data archival.
• Work closely with data scientists and business analysts to understand data requirements and translate them into technical solutions.
• Collaborate with DevOps and IT teams to deploy, monitor, and troubleshoot data systems.
• Develop and maintain documentation on data infrastructure and processes.
• Stay current with the latest data engineering technologies, tools, and practices.

Qualifications

• Bachelor's degree in computer science, engineering, or related field.
• Minimum of 3 years of experience in data engineering roles.
• Strong proficiency in SQL, ETL processes, and database management systems (e.g., MySQL, PostgreSQL, MongoDB).
• Hands-on experience with AWS services for data processing, storage, and analysis (e.g., S3, Redshift, EMR, Glue).
• Familiarity with programming languages such as Python or Java.
• Understanding of data warehousing concepts and data modeling techniques.
• Experience working with big data technologies (e.g., Hadoop, Spark) is an advantage.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.