Lead Data Engineer (Snowflake, dbt) – 12-Month Fixed-Term Contract

CommBank; Sydney; On-site; AUD 150,000 - 210,000; Full time

Job summary

CommBank in Sydney is seeking a hands-on Lead Data Engineer to guide a small team of 3-4 engineers, design production-grade data pipelines, and set engineering standards.

You will work with stakeholders across FCC and technology teams to translate complex financial crime requirements into reliable data solutions. This role offers opportunity to influence data engineering practices and deliver secure, scalable data solutions.

Qualifications

• Senior data engineer with leadership experience
• Proven track record building production-grade data pipelines
• Strong SQL and Snowflake experience
• dbt expertise and data modelling skills

Responsibilities

• Act as a senior hands-on engineer, designing, building, testing, deploying and supporting data engineering solutions.
• Lead and line-manage a small team of 3-4 data engineers, analysts and QAs providing technical direction, coaching, feedback and development.
• Lead delivery of data engineering initiatives while contributing directly to the codebase and technical implementation.
• Design, build and optimise production-grade data pipelines, transformations and integration solutions.
• Write high-quality SQL and dbt code and contribute to complex engineering work where required.
• Review code produced by the team and ensure engineering standards are applied.
• Lead technical reviews and make pragmatic engineering decisions when requirements are unclear.
• Establish and maintain engineering standards for coding, testing, documentation, source control, deployment, monitoring and support.
• Translate business and data requirements into end-to-end technical solutions.
• Work with Snowflake, dbt, IBM StreamSets and related technologies for cloud/on-premise patterns.
• Diagnose and resolve data, performance and integration issues.
• Build data quality and control mechanisms into engineering solutions.
• Identify risks and delivery constraints early and drive resolution.
• Collaborate with engineers, architects, DB teams and stakeholders to ensure successful delivery.
• Promote reusable patterns and continuous improvement to speed, maintainability and control.
• Ensure security, resilience, and scalability aligned with enterprise standards.

Skills

SQL

Snowflake

dbt

Data pipelines

Cloud platforms

Leadership

Code reviews

CI/CD

GIT

Mentoring

Tools

dbt

Snowflake

Airflow

Job description

See yourself in our team

Financial Crime Compliance (FCC) is a team of over 190 professionals and is an integral part of CBA's Group Risk Function. FCC is accountable for the development, implementation and ongoing governance of the Group's financial crime compliance program, driving the Group's approach to managing Anti-Money Laundering and Counter-Terrorist Financing (AML/CTF), Sanctions, Anti-Bribery and Corruption (ABC), and Anti-Tax Evasion (ATE) risks and obligations.

What your role will involve

You will be part of a specialist team reporting to the Executive Manager, Financial Crime Compliance, with a primary focus on supporting ASB with the delivery of data engineering capabilities for Transaction Monitoring and broader financial crime initiatives.

This is a hands-on Lead Data Engineer role. You will act as both a senior individual contributor and the technical and people lead for a small team of 3-4 data engineers.

You will be expected to design solutions, write and review production code, build and troubleshoot data pipelines, and contribute directly to engineering delivery, while also setting technical direction, establishing engineering standards and leading the day-to-day delivery of the team.

You will work closely with stakeholders across ASB, FCC Australia and New Zealand, and technology teams to translate complex financial crime and business requirements into reliable, scalable and well-controlled data solutions.

In this role, you will:

• Act as a senior hands-on engineer, designing, building, testing, deploying and supporting data engineering solutions.


• Lead and line-manage a small team of 3-4 data engineers, analysts and QAs providing technical direction, coaching, feedback and development.


• Lead delivery of ASB data engineering initiatives while also contributing directly to the codebase and technical implementation.


• Design, build and optimise production-grade data pipelines, transformations and integration solutions.


• Write high-quality, maintainable SQL and dbt code and contribute directly to complex engineering work where required.


• Review code produced by the team, provide constructive technical feedback and ensure agreed engineering standards are consistently applied.


• Lead technical and solution design reviews and make pragmatic engineering decisions where requirements, designs or delivery approaches are unclear.


• Establish and maintain engineering standards covering coding, testing, documentation, source control, deployment, monitoring and support.


• Translate business, data and financial crime requirements into practical end-to-end technical solutions.


• Work across Snowflake, dbt, IBM StreamSets and related technologies to support cloud, on-premises and Oracle-integrated data patterns.


• Diagnose and resolve complex data, performance and integration issues, including production problems where required.


• Build data quality, reconciliation, load assurance and control requirements into engineering solutions.


• Identify technical risks, dependencies and delivery constraints early and drive them through to resolution.


• Work closely with engineers, architects, database teams, business SMEs and technology stakeholders to support successful delivery.


• Promote reusable engineering patterns, automation and continuous improvement that improve delivery speed, maintainability and control.


• Ensure solutions are secure, resilient, scalable and aligned with relevant enterprise technology and engineering standards.

We're interested in hearing from people who:

• You are an experienced senior or lead data engineer who combines strong hands-on engineering capability with the ability to lead and drive delivery through a team.


• You are comfortable moving between hands-on technical work, code and design reviews, troubleshooting complex data problems, coaching engineers and engaging with senior business and technology stakeholders.

You will bring:

• Strong and recent hands-on data engineering experience, including personally building and supporting production-grade data pipelines.


• Advanced SQL skills and strong experience with cloud data platforms, ideally Snowflake.


• Strong hands-on experience with dbt, including developing transformations, models, tests and reusable engineering components.


• Demonstrated experience writing production code and remaining technically hands-on while leading other engineers.


• Experience providing technical leadership to data engineers, including code review, solution design and engineering standards.


• Strong understanding of software and data engineering practices including Git/source control, CI/CD, automated testing, deployment and production support.


• Experience implementing data quality, reconciliation, load assurance, monitoring and control mechanisms.


• Exposure to IBM StreamSets or similar data movement and integration technologies.


• Experience working across cloud and on-premises integration patterns; Oracle experience would be advantageous.


• Strong debugging and problem-solving skills, including the ability to investigate complex data and pipeline issues.


• Ability to work through ambiguous requirements, identify gaps, challenge proposed approaches and shape fit-for-purpose solutions.


• Strong stakeholder management skills and the confidence to provide technical direction across engineering, architecture, business and operational teams.


• Experience in financial services, Financial Crime or Transaction Monitoring would be advantageous but is not essential.

Working with us

At CommBank, we're committed to creating an accessible, inclusive and respectful workplace. If you require support or adjustments, please let us know.

We welcome applications from people of all backgrounds, and we're particularly committed to making a positive difference for Aboriginal and/or Torres Strait Islander Peoples. For support, please contact 1800 989 ***.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 ***.