Senior Data Engineer, Data Platform

Macquarie Bank Limited; London; On-site; GBP 70,000 - 100,000; Full time

Job summary

Join Macquarie as a Data Platform Engineer, where you'll design and optimize innovative data platforms utilizing modern cloud technologies. This pivotal role involves managing data lakes, ensuring high performance, and creating secure environments for efficient data processing, all while working in a supportive team dedicated to diversity and innovation.

Qualifications

• Strong background in Data, DevOps, and Engineering.
• Experience in building automation and CI/CD pipelines.
• Understanding of modern data platforms and query engines.

Responsibilities

• Designing, building, and optimizing a petabyte-scale data platform.
• Managing and enhancing data lakes and platforms.
• Ensuring high-performance data workload execution.

Skills

Data Engineering

DevOps

Python

Cloud Technologies

SQL

Data Lake

Data Warehouse

Tools

AWS

Linux/Unix

EKS

Airflow

Trino

Job description

At Macquarie, our Data Services Team drives innovation by delivering a diverse suite of data products that empower data-driven decision-making and enhance operational efficiency. With a strong focus on engineering, data science, and analytics, the team delivers innovative solutions that empower business users, primarily trading teams, to tackle complex challenges and unlock new opportunities.

At Macquarie, our advantage is bringing together diverse people and empowering them to shape all kinds of possibilities. We are a global financial services group operating in 31 markets with 56 years of unbroken profitability. You’ll be part of a friendly and supportive team where everyone—regardless of role—contributes ideas and drives outcomes.

What role will you play?

As a Data Platform Engineer, you will play a pivotal role in designing, building, and optimising a cutting-edge, petabyte-scale data platform powered by modern cloud technologies.

You will manage and enhance a petabyte-scale Data Lake and create secure, efficient, and scalable environments for our data platforms. Leveraging cloud-native technologies and AWS tools such as AWS S3, EKS, Glue, Airflow, Trino, and Parquet, you will prepare to adopt Apache Iceberg for greater performance and flexibility. You’ll address high-performance data workloads, ensuring seamless execution of massive queries, including 600+ billion-row queries in Redshift, by designing and maintaining robust, scalable infrastructure. Our flat structure means you will directly contribute to our strategy while taking ownership of diverse projects utilizing the latest technologies.

What you offer

• A dynamic individual with a strong Data, DevOps, and Engineering background who loves solving data problems and building automation and CI/CD pipelines in the data space and cloud infrastructure.
• Good understanding of modern Data Platforms, Databases, Data Lakes, Data Warehouses, and Query Engines, SQL/DDLs.
• Experience with Python coding/testing or any Cloud-based technology (AWS preferred).
• Good understanding of hosting platforms Linux/Unix (EKS and container experience is a plus).

We love hearing from anyone inspired to build a better future with us. If you're excited about the role or working at Macquarie, we encourage you to apply.

About Technology

Technology enables every aspect of Macquarie, for our people, our customers, and our communities. We’re a global team passionate about accelerating the digital enterprise, connecting people and data, building platforms and applications, and designing tomorrow’s technology solutions.

Our commitment to diversity, equity, and inclusion

We are committed to providing a working environment that embraces diversity, equity, and inclusion. We encourage people from all backgrounds to apply, regardless of identity, including age, disability, neurodiversity, gender, sexual orientation, marital status, race, religion, or socio-economic background. We welcome discussions on how you can feel included and belong at Macquarie during the recruitment process.

We aim to provide reasonable adjustments during recruitment and employment. If you require assistance, please let us know during the application process.