Senior Data Engineer - Capital Markets

Macquarie Group; Sydney; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Wellbeing leaves

Parental leave (up to 20 weeks)

Volunteer leave & donation matching

Hybrid and flexible working

Learning & development support

Job summary

Macquarie Group's Capital Technology team is seeking a senior data/software engineer to design, build, test, deploy and support data pipelines and platform features. You will translate finance requirements into technical designs, collaborate with business analysts, source-system owners, and apply AI-assisted engineering responsibly.

This role offers a collaborative, hybrid work environment with extensive data and cloud tech, and opportunities to shape scalable enterprise solutions.

Qualifications

• 8+ years of data or software engineering experience with Python.
• Advanced SQL skills including joins, CTEs and window functions.
• Experience building scalable ETL pipelines and data models.
• Experience with Spark or PySpark, performance optimization, cloud cost awareness.
• Hands-on AWS experience (Redshift, S3, Glue, IAM, Kinesis); familiarity with GCP, SQS/SNS or Kafka is a plus.
• Experience with Airflow/Argo/dbt for scheduling, retries and backfills.
• Experience with metadata, lineage, reconciliation, and data protection controls.
• Knowledge of Docker and Unix/Linux; Kubernetes experience is a plus.
• Familiarity with AI-assisted engineering tools and document processing capabilities.

Responsibilities

• Design, build, test, deploy and support data pipelines and platform features.
• Translate finance requirements into technical designs, source-to-target mappings and acceptance criteria.
• Collaborate with business analysts and source-system owners to ensure reliable data solutions.
• Ensure secure access, data protection and auditability across pipelines.
• Support production operations, observability and issue resolution.

Skills

Python

Advanced SQL

Spark/PySpark

Cloud (AWS)

Airflow/dbt

Docker

Kubernetes

Git & CI/CD

Data Warehousing

Stakeholder management

Tools

AWS Redshift

S3

Glue

IAM

Kinesis

GCP

Kafka

Airflow

Argo

dbt

Job description

Join our Macquarie Capital Technology team supporting finance reporting, analytics and business operations within Macquarie Capital. Our team partners with finance stakeholders to understand their needs and deliver reliable solutions that support informed decision-making. You will join a collaborative and supportive environment where everyone contributes ideas and drives outcomes.

We are a global financial services group operating in 30 markets with 57 years of unbroken profitability. At Macquarie, you’re empowered to shape a career that is fulfilling and creates value. You will bring your insights and expertise to the task at hand and feel supported as you make your own kind of impact for a better future.

What role will you play?

In this role you will design, build, test, deploy and support data pipelines and platform features. You will work with business specialists, technical business analysts and source-system owners to translate finance requirements into technical designs, source-to-target mappings, acceptance criteria and testable transformations, while investigating data and applying artificial intelligence-assisted engineering responsibly.

What you offer

• 8+ years’ experience in data or software engineering, with strong Python skills and a record of delivering maintainable enterprise solutions.
• Advanced SQL skills, including joins, common table expressions and window functions.
• Experience building scalable extract, transform and load pipelines, reusable transformations and relational or dimensional models, including incremental loading, schema evolution and batch or streaming integration.
• Experience with Spark or PySpark, including performance optimisation and cloud cost awareness.
• Hands-on experience with Amazon Web Services, including Redshift, S3, Glue, Identity and Access Management and Kinesis, plus familiarity with Google Cloud and SQS, SNS or Kafka.
• Experience with Airflow, Argo or dbt, including dependency management, scheduling, retries and backfills.
• Experience implementing metadata, lineage, reconciliation and completeness checks, with secure access, data protection and auditability.
• Working knowledge of Docker and Unix or Linux, with Kubernetes experience advantageous.
• Experience with Git, code review, automated testing, continuous integration and deployment, controlled releases, observability, recoverable processing and production support.
• Familiarity with approved artificial intelligence-assisted engineering tools such as GitHub Copilot, with independent validation and protection of confidential data; exposure to document processing, embeddings, vector search, retrieval-augmented generation and Amazon Bedrock or equivalent is advantageous.
• Strong stakeholder engagement skills, including investigating data issues, challenging assumptions and communicating dependencies and risks; experience in agile teams, knowledge sharing and financial services or trading is advantageous.

What we offer

At Macquarie, you’re empowered to shape a career that’s rewarding in all the ways that matter most to you. Macquarie employees can access a wide range of benefits which, depending on employment type, include:

• 1 wellbeing leave day per year
• Up to 5 additional service bonus leave days per year
• Up to 20 weeks’ paid parental leave for primary caregivers along with 12 days of transition leave upon return to work, and 6 weeks’ paid leave for non-primary caregivers
• 2 days of paid volunteer leave and donation matching
• Up to 12 months’ gender affirmation leave, including 6 weeks’ paid leave
• Access to Employee Assistance Program and wellbeing benefits including skin and health checks, and flu vaccinations
• Access to a wide range of salary packaging options
• Access to a wide range of learning and development opportunities, including reimbursement for professional membership or subscription
• Hybrid and flexible working arrangements, dependent on role
• Reimbursement for work from home equipment

About Technology

Technology enables every aspect of Macquarie, for our people, our customers and our communities. We’re a global team that is passionate about accelerating the digital enterprise, connecting people and data, building platforms and applications and designing tomorrow’s technology solutions.

Inclusion at Macquarie

We are committed to providing an inclusive environment for all, where different experiences, skills and perspectives are valued and respected. Macquarie provides access to opportunities for all individuals regardless of race, colour, religion, sex, sexual orientation, national origin, age, disability, protected veteran status, genetic information, marital status, gender identity or any other characteristic or circumstance.

We provide reasonable adjustments to individuals who may need support during the recruitment process and employment. If you require an adjustment, please let us know during the application process.