Principal Data Engineer (Snowflake, AWS, Python)

Commonwealth Bank

Sydney

On-site

AUD 180,000 - 260,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Commonwealth Bank is seeking a Principal Data Engineer to lead hands-on data engineering across AWS, Snowflake and real-time streaming architectures. You’ll shape design choices, modernise large-scale data platforms and mentor engineers to deliver end-to-end data solutions that power smarter customer experiences.

You will work on Spark, Kafka, batch and streaming pipelines, drive architecture decisions, champion AI-assisted engineering and collaborate with global teams to lift capability,

Qualifications

  • Extensive data engineering leadership across enterprise-scale platforms.
  • Deep hands-on experience with AWS, Snowflake and real-time data technologies.
  • Proficiency in Python and Spark; experience with Kafka and streaming architectures.

Responsibilities

  • Provide hands-on technical leadership across data engineering and architecture.
  • Shape and modernise enterprise data platforms on AWS.
  • Lead end-to-end data solutions from problem definition to deployment.
  • Mentor engineers and raise team capability.
  • Collaborate with cross-functional teams to deliver real-time data pipelines.

Skills

Data leadership
AWS
Snowflake
Kafka
Python
Spark
Real-time streaming
Batch processing
AI-assisted engineering
Architecture leadership

Tools

AWS
Snowflake
Kafka
Spark
Python
Databricks

Job description

  • We’re building smarter, real-time customer experiences with AWS, Snowflake and Kafka.
  • You have deep data engineering expertise and thrive on solving complex problems at scale.
  • Together we will modernise data platforms and use AI to transform customer experiences.

Do work that matters:

Join our Customer Service Network team within Assisted Technology and help reimagine how our branch colleagues support millions of customers. As a Principal Data Engineer, you’ll provide hands-on technical leadership across AWS, Snowflake and modern data engineering, building scalable platforms that turn complex data into simpler, smarter customer experiences.You’ll shape architecture, modernise legacy data environments and engineer solutions across Spark, Kafka/MSK, batch and real-time streaming. From setting engineering standards to using AI-assisted engineering to accelerate delivery, you’ll influence how we build while mentoring engineers and lifting capability across the team.

See yourself in our team:

Our Customer Service Network team, within Assisted Technology, is reimagining how data and technology help our branch colleagues serve customers. We’re building the data foundations behind intelligent concierge experiences, agentic appointment booking, customer-intent capture, skills matching and smarter branch operations, connecting customer journeys, colleague experiences and operational data in real time.

We’re creating a modern, cloud-first data ecosystem using AWS, Snowflake and Kafka, with real-time messaging, event-driven architectures and scalable data pipelines at its core. The team is also exploring AI-powered engineering and AI-ready data capabilities to turn trusted, real-time data into smarter experiences and decisions. With significant greenfield engineering ahead, we’re solving complex data challenges together and building capabilities designed to help colleagues serve customers faster, smarter and more seamlessly.

We’re interested in hearing from people who:

  • Bring Principal-level technical leadership across data engineering, architecture and full-cycle delivery
  • Have deep hands-on experience building large-scale, enterprise data platforms on AWS
  • Are highly proficient in Python, building production-grade data pipelines, services and engineering solutions
  • Have strong experience with Kafka and real-time messaging, including streaming and event-driven architectures
  • Can architect batch, streaming and near-real-time data solutions across complex environments
  • Own solutions end to end, from problem definition and architecture through engineering, deployment, observability and optimisation
  • Thrive on solving big, complex engineering problems, simplifying disconnected systems and making pragmatic architectural decisions
  • Have experience modernising data ecosystems, including migration from legacy warehouse technologies toward Snowflake
  • Stay hands-on as a Principal Engineer, setting engineering standards, mentoring others and lifting technical capability across teams

We don't expect you to know everything, but experience in several of the following will set you up for success:

  • Cloud: AWS, S3, Lambda, Kinesis, Redshift, Glue, EMR, Athena, IAM, SQS/SNS, ECS/EKS, DynamoDB
  • Data Platform: Snowflake, Databricks
  • Data Modernisation: Enterprise-scale data platform and warehouse modernisation/migration, Teradata to Snowflake
  • Core Engineering: Python, PySpark, SQL, Scala
  • Distributed Processing: Apache Spark, distributed processing, batch processing, streaming
  • Real-Time Streaming: Kafka, Amazon MSK, Flink
  • Data Engineering: ETL, complex enterprise data pipelines
  • Data Warehousing: Snowflake, Teradata, Hadoop/Cloudera, Hive, Oracle
  • DevOps: CI/CD, GitHub Actions, Infrastructure as Code, CloudFormation, AWS CDK
  • AI-Assisted Engineering: AI-assisted development, ETL automation, engineering productivity, quality and delivery acceleration
  • AI / GenAI: GenAI concepts and practical engineering applications

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), we’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 ***.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineer (Snowflake, AWS, Python)
Principal Data Engineer (Snowflake, AWS, Python)

CommBank • Sydney

On-site
AUD 180,000 - 240,000
Senior Data Engineer (Snowflake, AWS, Big Data)
Senior Data Engineer (Snowflake, AWS, Big Data)

CommBank • Sydney

On-site
AUD 140,000 - 180,000
Senior Data Engineer (Snowflake, AWS, Big Data)
Senior Data Engineer (Snowflake, AWS, Big Data)

Commonwealth Bank • Sydney

On-site
AUD 180,000 - 240,000
Principal Data Engineer (Aws)
Principal Data Engineer (Aws)

Commonwealth Bank Of Australia • Western Australia

Hybrid
AUD 180,000 - 280,000
Engineering Executive Manager-Group Security (Data And Software)
Engineering Executive Manager-Group Security (Data And Software)

Commonwealth Bank • Melbourne

On-site
AUD 210,000 - 280,000
Principal Data Engineer — Real-Time Data on AWS & Snowflake
Principal Data Engineer — Real-Time Data on AWS & Snowflake

Commonwealth Bank • Sydney

On-site
AUD 180,000 - 260,000
Principal Data Engineer (AWS)
Principal Data Engineer (AWS)

Commonwealth Bank of Australia • Sydney

Hybrid
AUD 180,000 - 240,000
Data Product Management Senior Manager
Data Product Management Senior Manager

Commbank • Sydney

On-site
AUD 180,000 - 240,000
Principal Software Engineer - Full Stack (Java)
Principal Software Engineer - Full Stack (Java)

Commonwealth Bank Of Australia • Melbourne

On-site
AUD 180,000 - 260,000
Principal Data Engineer - Real-Time AI with Snowflake/AWS
Principal Data Engineer - Real-Time AI with Snowflake/AWS

CommBank • Sydney

On-site
AUD 180,000 - 240,000
Top locations