Staff Data Engineer: Pipelines, MLOps & Data Products

Commonwealth Bank; New South Wales; On-site; AUD 140,000 - 180,000; Full time

Job summary

Commonwealth Bank seeks a Staff Data Engineer to lead design and delivery of scalable data solutions. You will shape data pipelines, ontologies and reusable data products for dashboards and analytics, while automating development and deployment lifecycles.

You will mentor engineers, implement data quality controls and coordinate data preparation, testing and release management in a cloud environment.

Qualifications

• Strong experience in data engineering and large-scale data platforms.
• Advanced Python and/or R programming with SQL skills.
• Experience building production-grade data pipelines (batch/streaming).
• Experience with data modelling, ontology, and data governance.

Responsibilities

• Design and build scalable batch, streaming and analytical data pipelines.
• Transform source data into trusted, reusable, analytics-ready datasets.
• Create curated data layers and data products for dashboards and reporting.
• Automate dashboard data lifecycle, including ingestion, testing, deployment and monitoring.
• Develop agentic workflows coordinating data prep, validation, metadata, and dashboard updates.
• Build and maintain CI/CD pipelines using GitHub Actions.
• Design data models and ontologies and establish standards for data definitions.
• Implement data matching, entity resolution, deduplication and data cleansing.

Skills

Data engineering

Python

R

SQL

Big data

Cloud

CI/CD

Mentoring

GitHub Actions

Tools

GitHub Actions

ETL Tools

Spark

Kubernetes

Job description

Commonwealth Bank seeks a Staff Data Engineer to lead design and delivery of scalable data solutions. You will shape data pipelines, ontologies and reusable data products for dashboards and analytics, while automating development and deployment lifecycles.

You will mentor engineers, implement data quality controls and coordinate data preparation, testing and release management in a cloud environment.