Senior Data Engineer, Data Platform | London, UK

Macquarie Group; London; On-site; GBP 60,000 - 90,000; Full time

Job summary

Join Macquarie Group as a Data Platform Engineer to design and optimize innovative data solutions. You'll work with cutting-edge cloud technologies, tackling complex data challenges on a petabyte-scale platform. If you're passionate about data engineering and automation, this role provides an opportunity to drive outcomes in a diverse and supportive team.

Qualifications

• Strong background in Data, DevOps, and Engineering.
• Experience with cloud technologies, preferably AWS.
• Good understanding of modern Data Platforms, Databases, and Data Lakes.

Responsibilities

• Design and optimize a petabyte-scale data platform.
• Manage and enhance the Data Lake.
• Ensure seamless execution of massive queries and robust infrastructure.

Skills

Data Engineering

DevOps

Automation

CI/CD Pipelines

Python

Tools

AWS S3

EKS

Glue

Airflow

Redshift

Job description

At Macquarie, our Data Services Team drives innovation by delivering a diverse suite of data products that empower data-driven decision-making and enhance operational efficiency. With a strong focus on engineering, data science, and analytics, the team delivers innovative solutions that empower business users primarily trading teams to tackle complex challenges and unlock new opportunities.

At Macquarie, our advantage is bringing together diverse people and empowering them to shape all kinds of possibilities. We are a global financial services group operating in 31 markets and with 56 years of unbroken profitability. You'll be part of a friendly and supportive team where everyone - no matter what role - contributes ideas and drives outcomes.

What role will you play?

As a Data Platform Engineer, you will play a pivotal role in designing, building, and optimising a cutting-edge, petabyte-scale data platform powered by modern cloud technologies.

In this role, you will manage and enhance a petabyte-scale Data Lake and will create secure, efficient, and scalable environments for our data platforms. You will leverage cloud-native technologies and AWS tools such as AWS S3, EKS, Glue, Airflow, Trino, and Parquet, while preparing to adopt Apache Iceberg for even greater performance and flexibility. You'll tackle high-performance data workloads, ensuring seamless execution of massive queries, including 600+ billion-row queries in Redshift, by designing and maintaining robust, scalable infrastructure. Our flat structure means that you will directly contribute to our strategy while taking ownership of a diverse range of projects utilising the latest technologies.

What you offer

• A dynamic individual with a strong Data, DevOps and Engineering background who loves to solve data problems and build automation and CI/CD Pipelines in the data space and cloud infrastructure.
• Good understanding of modern Data Platforms, Databases, Data Lakes, Data Warehouses and Query Engines, SQL/DDLs
• Experience with Python coding/testing or any Cloud-based technology (AWS preferred)
• Good understanding of Hosting Platform Linux/Unix (EKS and Container experience is a plus)

We love hearing from anyone inspired to build a better future with us, if you're excited about the role or working at Macquarie we encourage you to apply.

About Technology

Technology enables every aspect of Macquarie, for our people, our customers and our communities. We're a global team that is passionate about accelerating the digital enterprise, connecting people and data, building platforms and applications and designing tomorrow's technology solutions.

Our commitment to diversity, equity and inclusion

We are committed to providing a working environment that embraces diversity, equity, and inclusion. We encourage people from all backgrounds to apply regardless of their identity, including age, disability, neurodiversity, gender (including gender identity or expression), sexual orientation, marriage or civil partnership, pregnancy, parental status, race (including ethnic or national origin), religion or belief, or socio-economic background. We welcome further discussions on how you can feel included and belong at Macquarie as you progress through our recruitment process.
Our aim is to provide reasonable adjustments to individuals as required during the recruitment process and in the course of employment. If you require additional assistance, please let us know during the application process.

A career at Macquarie means you’ll have the opportunity to develop and utilise new skills, explore interesting fields and do challenging work that will impact the lives of people around the world—whether it’s accelerating the green energy transition, helping sustain global food supplies, financing social housing projects or investing in essential infrastructure. At Macquarie, we’re empowering people to innovate and invest for a better future.

Our size and international presence means your work can take you anywhere—across business groups, disciplines, sectors and borders. With employees and offices in 31 markets around the world, we’re a truly global organisation.

You’ll be supported by a diverse team where the unique perspectives, ideas and experiences that all of our people bring are valued. You’ll be empowered to address unmet needs in our communities whilst advising and investing alongside our clients and partners. Working with us, you’ll have the opportunity to make a difference.

Macquarie is a global financial group providing clients with asset management, retail and business banking, wealth management, leasing and asset financing, market access, commodity trading, renewables development, specialist advisory, capital raising and principal investment.

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.