Data Engineer, Data Platform

Macquarie Group; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

1 wellbeing leave day per year

25 days annual leave

Parental leave

Fertility leave

Volunteer leave

Salary sacrificing options

Wellbeing and insurance

Flexible working arrangements

Home office equipment reimbursement

Job summary

Macquarie Group is seeking a Data Platform Engineer to design, build and optimize a petabyte-scale data platform powered by modern cloud technologies in a hybrid work model. You will manage a Data Lake, ensure secure, scalable environments, and drive performance with AWS tools such as S3, EKS, Glue, Airflow, Trino and Parquet.

The role emphasizes delivering high-performance queries and building robust data infrastructure.

Qualifications

• Experience with Python and cloud tech (AWS preferred).
• Strong background in Data Platforms, Data Lakes/Warehouses, SQL.
• Experience building data pipelines and CI/CD in data space.

Responsibilities

• Design and build a petabyte-scale data platform powered by cloud technologies.
• Manage and enhance a Data Lake and secure, scalable environments for data platforms.
• Leverage AWS tools like S3, EKS, Glue, Airflow, Trino, Parquet and prepare to adopt Iceberg.

Skills

Data platform engineering

DevOps

CI/CD pipelines

Python

AWS

Linux/Unix

SQL

Tools

AWS

EKS

Glue

Airflow

Trino

Parquet

Iceberg

Job description

At Macquarie, our Data Services Team drives innovation by delivering a diverse suite of data products that empower data-driven decision-making and enhance operational efficiency. With a strong focus on engineering, data science, and analytics, the team delivers innovative solutions that empower business users primarily trading teams to tackle complex challenges and unlock new opportunities.

We are a global financial services group operating in 30 markets with 57 years of unbroken profitability. At Macquarie, you’re empowered to shape a career that is fulfilling and creates value. You will bring your insights and expertise to the task at hand and feel supported as you make your own kind of impact for a better future.

What role will you play?

Press space or enter keys to toggle section visibility

As a Data Platform Engineer, you will play a pivotal role in designing, building, and optimising a cutting-edge, petabyte-scale data platform powered by modern cloud technologies.

In this role, you will manage and enhance a petabyte-scale Data Lake and will create secure, efficient, and scalable environments for our data platforms. You will leverage cloud-native technologies and AWS tools such as AWS S3, EKS, Glue, Airflow, Trino, and Parquet, while preparing to adopt Apache Iceberg for even greater performance and flexibility. You’ll tackle high-performance data workloads, ensuring seamless execution of massive queries, including 600+ billion-row queries in Redshift, by designing and maintaining robust, scalable infrastructure. Our flat structure means that you will directly contribute to our strategy while taking ownership of a diverse range of projects utilising the latest technologies.

What you offer

Press space or enter keys to toggle section visibility

• A dynamic individual with a strong Data, DevOps and Engineering background who loves to solve data problems and build automation and CI/CD Pipelines in the data space and cloud infrastructure.
• Good understanding of modern Data Platforms, Databases, Data Lakes, Data Warehouses and Query Engines, SQL/DDLs
• Experience with Python coding/testing or any Cloud-based technology (AWS preferred)
• Good understanding of Hosting Platform Linux/Unix (EKS and Container experience is a plus)

What we offer

Press space or enter keys to toggle section visibility

At Macquarie, you’re empowered to shape a career that’s rewarding in all the ways that matter most to you. Macquarie employees can access a wide range of benefits which, depending on eligibility criteria, include:

• 1 wellbeing leave day per year and a minimum of 25 days of annual leave.
• 26 weeks’ paid parental leave for primary caregivers along with 12 days of paid transition leave upon return to work and 6 weeks’ paid leave for secondary caregivers
• Paid fertility leave for those undergoing or supporting fertility treatment
• 2 days of paid volunteer leave and donation matching
• Access to a wide range of salary sacrificing options
• Benefits and initiatives to support your physical, mental and financial wellbeing including, comprehensive medical and life insurance cover
• Access to our Employee Assistance Program, a robust behavioural health network with counselling and coaching services
• Access to a wide range of learning and development opportunities, including reimbursement for professional membership or subscription
• Access to company funded emergency and backup dependent care services
• Recognition and service awards
• Hybrid and flexible working arrangements, dependent on role
• Reimbursement for work from home equipment

About Technology

Press space or enter keys to toggle section visibility

Technology enables every aspect of Macquarie, for our people, our customers and our communities. We’re a global team that is passionate about accelerating the digital enterprise, connecting people and data, building platforms and applications and designing tomorrow’s technology solutions.

Inclusion at Macquarie

Press space or enter keys to toggle section visibility

We are committed to providing an inclusive environment for all, where different experiences, skills and perspectives are valued and respected. Macquarie provides access to opportunities for all individuals regardless of their identity, including age, disability, neurodiversity, gender (including gender identity or expression), sexual orientation, marriage or civil partnership, pregnancy, parental status, race (including ethnic or national origin), religion or belief, or socio-economic background.
We provide reasonable adjustments to individuals who may need support during the recruitment process and employment. If you require an adjustment, please let us know during the application process.