Staff Data Engineer – AWS & AI Data Platforms

Commonwealth Bank; Sydney; Hybrid; AUD 200,000 - 260,000; Full time

Job summary

Commonwealth Bank is seeking a Staff Data Engineer to lead data platform initiatives in AWS Cloud, Gen AI, and Data Mesh as part of the BB Technology team. You will help build data‑driven solutions and data products across secure, reliable pipelines to empower decision making for millions of customers.

The role offers flexible working options with half monthly office presence in Sydney or Melbourne, and a culture of collaboration, quality, and continuous improvement.

Qualifications

• AWS Certified Data Engineer Associate
• Strong Python, PySpark, SQL, Spark, Scala in distributed processing
• Experience with AWS data platforms: Glue, Lambda, Redshift, Athena, Kinesis, EMR
• Data governance and security: AWS DataZone, Lake Formation, IAM, encryption
• Familiar with AI coding assistants like Cline, Roo and Aider
• Exposure to AWS Marketplace, API Gateway and data monetization strategies
• CI/CD with Terraform, CloudFormation, GitOps, serverless frameworks
• Fine-tuning ETL, query performance and cost optimization
• Experience with Snowflake or Apache Iceberg
• Knowledge of data product thinking and data mesh principles

Skills

Python

PySpark

SQL

Spark

Scala

AWS Data Platform

Terraform

CloudFormation

GitOps

API Gateway

Data Mesh

Data Governance

IAM

Encryption

Snowflake

Iceberg

Kinesis

Redshift

Job description

Commonwealth Bank is seeking a Staff Data Engineer to lead data platform initiatives in AWS Cloud, Gen AI, and Data Mesh as part of the BB Technology team. You will help build data‑driven solutions and data products across secure, reliable pipelines to empower decision making for millions of customers.

The role offers flexible working options with half monthly office presence in Sydney or Melbourne, and a culture of collaboration, quality, and continuous improvement.