Staff Data Engineer

JobCubby; Sydney; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Flexible working options

Part-time arrangements

Job share

Job summary

Commonwealth Bank is seeking a Staff Data Engineer to design and build next-gen data platforms and pipelines. You will focus on data security, governance, and compliance while promoting data discoverability and stewardship across the BB Technology team.

You’ll work with Python, PySpark, SQL and AWS data services to deliver scalable data products that empower business decisions and risk management. The role offers hybrid work options with offices in Sydney or Melbourne.

Qualifications

• Experience in designing scalable data products and engineering roadmaps.
• Strong learning mindset and collaboration skills.
• Knowledge of data catalogues, governance, and compliance.

Responsibilities

• Design and build next-gen data platforms and pipelines.
• Drive adoption of data catalogues, glossaries and stewardship.
• Ensure data security, governance, and regulatory compliance.
• Deliver end-to-end data products that meet business needs.

Skills

Python

PySpark

SQL

AWS data platforms

Data governance

Data security

Distributed data processing

GitOps

CI/CD

Terraform

Tools

Snowflake

Apache Iceberg

AWS Glue

Redshift

Athena

EMR

Job description

to apply - email only, no card. You can also save this posting or score it againstyour profile with AI.## About the roleDesign and build next-gen data platforms and pipelines while ensuring data security, governance, and compliance. Drive the adoption of data catalogues and stewardship practices to promote discoverability and accountability across the organization.## RequirementsRequires strong expertise in Python, PySpark, SQL, and AWS data platforms with a focus on distributed data processing. Candidates should possess a strong learning mindset and experience in designing scalable data products and engineering roadmaps.## BenefitsFlexible working optionsPart-time arrangementsJob share## Full description* You are passionate to stay ahead of the latest AWS Cloud, Gen AI, Data Lake, and Data Mesh technologies.* We are one of the largest and most advanced Data Engineering teams in the country.* Together we can build state-of-the-art data solutions that power seamless experiences for millions of customers.Do work that matters:As a Staff Data Engineer with expertise in software development / programming and a passion for building data-driven solutions, you are ahead of trends and work at the forefront of AWS Cloud, Data Mesh and AI technologies.See yourself in our team:Join the Business Banking (BB) Technology team at CommBank, where we are driving innovation through Digital and Gen AI platforms that empower our Business Bank customers.Our team plays a pivotal role in delivering secure, reliable, and actionable data products. These assets support strategic decision-making, risk management, and customer success. This is driven by critical data assets which is supported by the Data Engineering teams within the BB Technology who are responsible for ingesting data, creating ESDM aligned Data Products and creating reports which will help business produce strategies.We are also interested in hearing from people who:* Think AI-first and are passionate about solving problems with intelligent data solutions.* Have a strong learning mindset and thrive in collaborative environments.* Champion a culture of quality, openness, and continuous improvement.* Design and build next-gen data platforms and pipelines using Python, PySpark, or Scala.* Integrate data from diverse sources into centralised lakes and cloud platforms.* Create technology blueprints and engineering roadmaps for long-term transformation.* Ensure data security, governance, and compliance.* Deliver end-to-end solutions that meet business needs and minimise risk.* Build high-quality, scalable data products from scratch.* Communicate effectively with stakeholders and contribute to team-wide engineering practices.* Define and evolve shared semantic models and metric definitions to ensure consistent meaning and reusable data across products and domains.* Drive adoption of catalogues, glossaries, and stewardship practices that promote discoverability, accountability, and self-service.* Embed policy-as-code for data access, classification, and retention ensuring compliance with internal and regulatory standards.* Implement automated testing, observability, and end-to-end lineage to improve data trust, traceability, and incident resolution speed.Key Skills & Experience:* AWS Certified Data Engineer Associate with demonstrable experience in Data Engineering.* Data Processing: Strong expertise in Python, PySpark, SQL, Spark, Scala, and distributed data processing.* Experience in AWS data platforms (Glue, Lambda, Redshift, Athena, Kinesis, EMR).* Data Governance & Security: Experience with AWS DataZone, Lake Formation, IAM, encryption.* Experience in using AI Powered coding Assistants like Cline, Roo and Aider.* Marketplace & APIs: Exposure to AWS Marketplace, API Gateway, and data monetization strategies.* Automation & CI/CD: Experience with Terraform, CloudFormation, GitOps, and serverless frameworks.* Performance Optimisation: Ability to fine-tune ETL jobs, query performance, and cost efficiencies.* Experience with Snowflake, or Apache Iceberg.* Knowledge of data product thinking and data mesh principles.Working with usWhether you are passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you.We support our people with the flexibility to balance where work is done with at least half your time each month connecting in our Sydney or Melbourne office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few.If this sounds like you, apply now!If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We're keen to support you with the next step in your career.We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.Advertising End Date: 24/09/2026