Staff Data Engineer (Big Data, AWS and Snowflake)

cba

Sydney

On-site

AUD 200,000 - 260,000

Full time

3 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

CommBank is seeking a Staff Data Engineer in Sydney to design and deliver scalable data solutions using Big Data on AWS, Snowflake and dbt. You will shape architecture, uplift engineering capability and influence critical technology decisions.

You will lead delivery across data, platform, operations and analytics teams, mentor engineers, and collaborate with stakeholders to implement secure, production-ready data products and apply GenAI to improve analytics and productivity.

Qualifications

  • Strong experience designing and delivering enterprise data pipelines using complex SQLs and programming languages such as Python / PySpark, Scala or Java.
  • Experience with AWS data engineering, especially with services such as Amazon S3, EMR/Spark, Airflow, Iceberg, and AWS Glue.
  • Experience using Snowflake in a production environment and an understanding of how data solutions are designed and built on the platform.
  • Experience with dbt or comparable data transformation frameworks.
  • Experience leading architecture and design reviews while balancing delivery, risk, security, maintainability and cost.
  • Demonstrated ability to mentor engineers and lead initiatives involving multiple teams and stakeholders.
  • Understanding of modern engineering practices, including source control, CI/CD, automated testing, DevSecOps and continuous integration and delivery.
  • Experience in using AI Engineering frameworks and tools, like Claude, LangGraph, LangChain, Codex, ChatGPT, Copilot, etc.

Responsibilities

  • Design, build, test and deploy scalable data solutions across the full engineering development lifecycle.
  • Lead engineering initiatives and coordinate delivery across data, platform, operations, and observability teams.
  • Review solution designs and architectures, providing practical guidance aligned with engineering standards and strategy.
  • Contribute to technical governance, helping teams make sound decisions about architecture, implementation, risk and adoption.
  • Support engineers when they encounter complex technical challenges and mentor them to build their capability.
  • Develop reliable data pipelines and data products that are secure, maintainable and production-ready.
  • Partner with technical and business stakeholders to understand business requirements, provide and assess different technical data solutions, and deliver meaningful outcomes.
  • Contribute to engineering recruitment activities, including technical interviews and the consistent application of hiring standards, and uplift our data engineering resource capabilities.
  • Contribute to how we will be using GenAI to improve our ways of working, deliver better data analytics and insights, and increase productivity.

Skills

Big Data
Python/PySpark
Scala/Java
AWS (S3, EMR)
Snowflake
dbt
Data pipelines
Mentoring
CI/CD
AI frameworks

Tools

Airflow
Iceberg
Kafka
Spark
Hadoop

Job description

Staff Data Engineer (Big Data, AWS and Snowflake)

Lead the design and delivery of modern data solutions supporting Home Buying.

Shape architecture, uplift engineering capability and influence critical technology decisions.

Build with Big Data AWS, Snowflake and dbt as CommBank modernises its data estate.

Do Work That Matters

Be part of the team at the heart of how CommBank serves Australia. Join a team where you'll have a positive impact on customers' lives, strengthen local communities and build a rewarding career.

See yourself in our team

Data powers the experiences we create for millions of customers. You'll join a collaborative engineering environment where you can solve complex problems, support other engineers and help shape the technology that underpins important customer experiences.

In this role, you will:
  • Design, build, test and deploy scalable data solutions across the full engineering development lifecycle.
  • Lead engineering initiatives and coordinate delivery across data, platform, operations, and observability teams.
  • Review solution designs and architectures, providing practical guidance aligned with engineering standards and strategy.
  • Contribute to technical governance, helping teams make sound decisions about architecture, implementation, risk and adoption.
  • Support engineers when they encounter complex technical challenges and mentor them to build their capability.
  • Develop reliable data pipelines and data products that are secure, maintainable and production-ready.
  • Partner with technical and business stakeholders to understand business requirements, provide and assess different technical data solutions, and deliver meaningful outcomes.
  • Contribute to engineering recruitment activities, including technical interviews and the consistent application of hiring standards, and uplift our data engineering resource capabilities.
  • Contribute to how we will be using GenAI to improve our ways of working, deliver better data analytics and insights, and increase productivity.
We're interested in hearing from people who:
  • Bring deep data engineering capability, sound technical judgement and the confidence to lead through influence. You'll be comfortable remaining hands-on while guiding solution decisions, supporting other engineers and collaborating across organisational boundaries.
Technical experience required
  • Strong experience designing and delivering enterprise data pipelines using complex SQLs and programming languages such Python / PySpark, Scala or Java.
  • PracticalAWSdata engineeringexperience, particularlywithservicessuchasAmazonS3,EMR/Spark,Airflow,Iceberg,andAWSglue.
  • StrongexperienceusingBigDatatechnologiessuchasSpark,Hadoop,Hive,Iceberg,Sqoop,KinesisorMSK/Kafka,andrelatedprocessingpatterns.
  • Experience using Snowflake in a production environment and an understanding of how data solutions are designed and built on the platform.
  • Experience with dbt or comparable data transformation frameworks.
  • Experience leading architecture and design reviews while balancing delivery, risk, security, maintainability and cost.
  • Demonstrated ability to mentor engineers and lead initiatives involving multiple teams and stakeholders.
  • Understanding of modern engineering practices, including source control, CI/CD, automated testing, DevSecOps and continuous integration and delivery.
  • Experience inusingAI Engineering frameworks and tools, like Claude, LangGraph, LangChain, Codex, ChatGPT, Copilot, etc.
Working with us

At CommBank, we're committed to creating an accessible, inclusive and respectful workplace. If you require support or adjustments, please let us know. We welcome applications from people of all backgrounds, and we're particularly committed to making a positive difference for Aboriginal and/or Torres Strait Islander Peoples. For support, please contact 1800 989 696.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Staff Data Engineer (Big Data, AWS and Snowflake)
Staff Data Engineer (Big Data, AWS and Snowflake)

Commonwealth Bank • Sydney

On-site
AUD 180,000 - 240,000
Staff Data Engineer (AWS, Java & Real-Time Data)
Staff Data Engineer (AWS, Java & Real-Time Data)

Commonwealth Bank • City of Melbourne

On-site
AUD 150,000 - 190,000
Senior Engineering Manager / Chapter Lead (Data Engineering)
Senior Engineering Manager / Chapter Lead (Data Engineering)

Commonwealth Bank • City of Melbourne

On-site
AUD 180,000 - 260,000
Senior Engineering Manager / Chapter Lead (Data Engineering)
Senior Engineering Manager / Chapter Lead (Data Engineering)

Commonwealth Bank • Council of the City of Sydney

On-site
AUD 180,000 - 260,000
Staff Data Engineer: Big Data, AWS & Snowflake Lead
Staff Data Engineer: Big Data, AWS & Snowflake Lead

cba • Sydney

On-site
AUD 200,000 - 260,000
Data Product Management Manager
Data Product Management Manager

Commonwealth Bank • Council of the City of Sydney

On-site
AUD 120,000 - 160,000
Lead Data Engineer (Snowflake, Dbt) – 12-Month Fixed-Term Contract
Lead Data Engineer (Snowflake, Dbt) – 12-Month Fixed-Term Contract

Commonwealth Bank Of Australia • Sydney

On-site
AUD 150,000 - 230,000
Staff Software Engineer (Full Stack, React, Next.js)
Staff Software Engineer (Full Stack, React, Next.js)

Commonwealth Bank • City of Melbourne

On-site
AUD 180,000 - 240,000
Staff Software Engineer (.Net)
Staff Software Engineer (.Net)

Commonwealth Bank • City of Melbourne

On-site
AUD 180,000 - 240,000
Lead Data Engineer (Snowflake, dbt) – 12-Month Fixed-Term Contract
Lead Data Engineer (Snowflake, dbt) – 12-Month Fixed-Term Contract

Commonwealth Bank • Sydney

On-site
AUD 180,000 - 230,000