Lead Data Platform Engineer — AWS & ML Deployment

Commonwealth Bank; Western Australia; Hybride; AUD 210 000 - 290 000; Plein temps

Résumé du poste

Commonwealth Bank is seeking a Principal Data Engineer (AWS) to shape the engineering direction for cloud-native platforms that enable scalable model development and deployment with strong governance. You will partner with credit risk modelling and data teams to deliver reliable, auditable data pipelines and ML workflows.

In this role you’ll drive platform strategy, embed controls, and mentor engineers while aligning with regulatory requirements and enterprise data marketplace patterns across

Qualifications

• Experience building cloud-native data and model platforms at scale.
• Experience productionising models or ML workloads.
• Experience building frameworks and tools to improve engineering productivity.
• Understand data integrity and accuracy in financial systems.

Responsabilités

• Define and drive platform strategy for capital provisioning modelling.
• Architect and build cloud-native platforms (AWS) supporting model and data workloads.
• Provide thought leadership and contribute to the design of technical solutions and consumption patterns, including data security and data management.
• Design solutions that consume and operationalise enterprise data marketplace assets.
• Lead engineering patterns for model and ML deployment, orchestration and monitoring.
• Drive migration from legacy platforms to strategic, governed environments.
• Ensure alignment with Model Risk Management, regulatory and audit requirements, including:Data lineage and traceability, Reproducibility of model outputs, Strong controls and validation.
• Partner with modelling teams to productionise models and improve reliability and performance.
• Influence architecture and engineering decisions across crews and domains.
• Set and uplift engineering standards and practices.
• Mentor engineers and contribute to a high-performing engineering culture.

Connaissances

Cloud platforms

AWS

Model deployment

PySpark

Python

SQL

Data governance

Mentoring

Outils

SageMaker

Airflow

Spark

Snowflake

Description du poste

Commonwealth Bank is seeking a Principal Data Engineer (AWS) to shape the engineering direction for cloud-native platforms that enable scalable model development and deployment with strong governance. You will partner with credit risk modelling and data teams to deliver reliable, auditable data pipelines and ML workflows.

In this role you’ll drive platform strategy, embed controls, and mentor engineers while aligning with regulatory requirements and enterprise data marketplace patterns across