Principal Data Engineer (AWS)

CommBank; Sydney; Hybrid; AUD 190,000 - 270,000; Full time

Benefits offered by this job

Flexible work locations

Technology hubs in Melbourne and Perth

Work-life balance options

Job summary

CommBank in Australia is seeking a Principal Engineer to shape platform strategy for capital provisioning modelling. You’ll architect and build cloud-native AWS platforms supporting model and data workloads, while embedding governance and controls.

Join a cross-disciplinary crew to productionise models, drive reliability, and uplift engineering standards across teams. Flexible work options and access to technology hubs in Melbourne and Perth are available.

Qualifications

• Experience building cloud-native data and model platforms at scale.
• Experience productionising models or ML workloads.
• Ability to influence architecture and align stakeholders on technical direction.

Responsibilities

• Define and drive platform strategy for capital provisioning modelling.
• Architect and build cloud-native AWS platforms supporting model and data workloads.
• Lead engineering patterns for model and ML deployment, orchestration and monitoring.
• Ensure alignment with regulatory, risk, and audit requirements including data lineage and reproducibility.

Skills

Cloud-native platforms

ML deployment

Engineering productivity

Data integrity

Stakeholder alignment

Mentoring engineers

Tools

AWS

Snowflake

Python

PySpark

Airflow

CI/CD

IaC

SQL

Job description

You are passionate about solving complex problem with the latest tech

We're the largest and most advanced Data Engineering teams in the country.

Together we build tomorrow’s bank with world class engineering

Do work that matters

The Capital Provisioning Modelling Crew builds and runs the platforms that support how credit risk models are developed, validated, implemented, and monitored aligning to the Model Development Lifecycle Methodology (MDLC), processes, and procedures. The outcomes produced by these models are used in managing the Group Risk Management functions including front line business processes as well as for regulatory reporting including loss provisioning, portfolio analysis, and reporting.

These are critical, model-driven systems operating under regulatory scrutiny, where accuracy, control and reliability are essential.

As a Principal Engineer, you will shape the engineering direction for platforms that enable data consumption, model execution and deployment at scale, while meeting strong governance and control requirements.

See yourself in the team

You’ll be part of the Capital Provisioning Modelling Crew, working across credit risk modelling, data and platform engineering.

The crew focuses on:

• Consuming trusted data from enterprise data marketplace
• Enabling model execution and orchestration at scale
• Supporting SageMaker-based model deployment and ML workloads
• Driving modernisation and decommissioning of legacy and sandpit environments
• Delivering efficiencies into the framework and tools that can help deliver the models in a safe, sound, and secure way
• Embedding controls, lineage and auditability by design

As a Principal Engineer, you will

• Define and drive platform strategy for capital provisioning modelling
• Architect and build cloud-native platforms (AWS) supporting model and data workloads
• Provide thought leadership and contributes to the design of technical solutions and consumption patterns, including data security and data management.
• Design solutions that consume and operationalise enterprise data marketplace assets
• Lead engineering patterns for model and ML deployment, orchestration and monitoring
• Drive migration from legacy platforms to strategic, governed environments
• Ensure alignment with Model Risk Management, regulatory and audit requirements, including:
  • Data lineage and traceability
  • Reproducibility of model outputs
  • Strong controls and validation
• Partner with modelling teams to productionise models and improve reliability and performance
• Influence architecture and engineering decisions across crews and domains
• Set and uplift engineering standards and practices
• Mentor engineers and contribute to a high-performing engineering culture

We’re interested in hearing from people who

• Have strong experience building cloud-native data and model platforms at scale
• Have experience productionising models or ML workloads
• Have experience in building frameworks and tools that can significantly improve engineering productivity
• Understand data integrity, reconciliation, and accuracy in financial systems
• Can influence across teams and align stakeholders on technical direction
• Have a natural drive to educate, communicate, and coordinate with different internal stakeholders and consultants.
• Are comfortable balancing technical debt with long-term platform strategy

Technical experience

• AWS (S3, EMR, Glue, Lambda, Redshift, SageMaker or similar)
• Snowflake or enterprise data platforms / data marketplace patterns
• Python, PySpark and distributed data processing
• Batch and streaming data pipelines (e.g. Airflow, Spark, Glue)
• CI/CD, automated testing and infrastructure-as-code
• Observability, monitoring and reliability practices
• Strong SQL and relational database experience

Working with us

Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.

Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across all of Australia and have opened technology hubs in Melbourne and Perth. We really love working here, and we think you will too.

We support our people with the flexibility to balance where work is done with at least half their time each month connecting in office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work in the role you’re interested in.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 ***.