Staff Data Engineer: Big Data, AWS & Snowflake Lead

cba; Sydney; On-site; AUD 200,000 - 260,000; Full time

Job summary

CommBank is seeking a Staff Data Engineer in Sydney to design and deliver scalable data solutions using Big Data on AWS, Snowflake and dbt. You will shape architecture, uplift engineering capability and influence critical technology decisions.

You will lead delivery across data, platform, operations and analytics teams, mentor engineers, and collaborate with stakeholders to implement secure, production-ready data products and apply GenAI to improve analytics and productivity.

Qualifications

• Strong experience designing and delivering enterprise data pipelines using complex SQLs and programming languages such as Python / PySpark, Scala or Java.
• Experience with AWS data engineering, especially with services such as Amazon S3, EMR/Spark, Airflow, Iceberg, and AWS Glue.
• Experience using Snowflake in a production environment and an understanding of how data solutions are designed and built on the platform.
• Experience with dbt or comparable data transformation frameworks.
• Experience leading architecture and design reviews while balancing delivery, risk, security, maintainability and cost.
• Demonstrated ability to mentor engineers and lead initiatives involving multiple teams and stakeholders.
• Understanding of modern engineering practices, including source control, CI/CD, automated testing, DevSecOps and continuous integration and delivery.
• Experience in using AI Engineering frameworks and tools, like Claude, LangGraph, LangChain, Codex, ChatGPT, Copilot, etc.

Responsibilities

• Design, build, test and deploy scalable data solutions across the full engineering development lifecycle.
• Lead engineering initiatives and coordinate delivery across data, platform, operations, and observability teams.
• Review solution designs and architectures, providing practical guidance aligned with engineering standards and strategy.
• Contribute to technical governance, helping teams make sound decisions about architecture, implementation, risk and adoption.
• Support engineers when they encounter complex technical challenges and mentor them to build their capability.
• Develop reliable data pipelines and data products that are secure, maintainable and production-ready.
• Partner with technical and business stakeholders to understand business requirements, provide and assess different technical data solutions, and deliver meaningful outcomes.
• Contribute to engineering recruitment activities, including technical interviews and the consistent application of hiring standards, and uplift our data engineering resource capabilities.
• Contribute to how we will be using GenAI to improve our ways of working, deliver better data analytics and insights, and increase productivity.

Skills

Big Data

Python/PySpark

Scala/Java

AWS (S3, EMR)

Snowflake

dbt

Data pipelines

Mentoring

CI/CD

AI frameworks

Tools

Airflow

Iceberg

Kafka

Spark

Hadoop

Job description

CommBank is seeking a Staff Data Engineer in Sydney to design and deliver scalable data solutions using Big Data on AWS, Snowflake and dbt. You will shape architecture, uplift engineering capability and influence critical technology decisions.

You will lead delivery across data, platform, operations and analytics teams, mentor engineers, and collaborate with stakeholders to implement secure, production-ready data products and apply GenAI to improve analytics and productivity.