Hybrid Data Platform Engineer: Petabyte-Scale Cloud Data

Macquarie Bank Limited; City Of London; Hybrid; GBP 65,000 - 85,000; Full time

Job summary

A global financial services group is seeking a Data Platform Engineer to design and optimize a petabyte-scale data platform. The role involves managing a Data Lake and leveraging AWS tools for high-performance workloads. Ideal candidates possess a strong Data and Engineering background, expertise in Python, and knowledge of modern data technologies. The company offers competitive benefits and a diverse working environment.

Benefits

25 days annual leave

Parental leave benefits

Paid volunteer leave

Employee Assistance Program

Qualifications

• Strong Data background with problem-solving skills.
• Experience building automation and CI/CD Pipelines.
• Good understanding of Data Lakes and Query Engines.

Responsibilities

• Design and build a cutting-edge, petabyte-scale data platform.
• Manage and enhance a petabyte-scale Data Lake.
• Ensure seamless execution of high-performance data workloads.

Skills

Data, DevOps, and Engineering background

Modern Data Platforms

SQL/DDLs

Python coding/testing

Linux/Unix knowledge

Tools

AWS

EKS

Airflow

Trino

Parquet

Job description

A global financial services group is seeking a Data Platform Engineer to design and optimize a petabyte-scale data platform. The role involves managing a Data Lake and leveraging AWS tools for high-performance workloads. Ideal candidates possess a strong Data and Engineering background, expertise in Python, and knowledge of modern data technologies. The company offers competitive benefits and a diverse working environment.