Staff Data Engineer - Payments Platform (AWS/Snowflake)

Commonwealth Bank Of Australia; Melbourne; On-site; AUD 180,000 - 240,000; Full time

Job summary

Commonwealth Bank of Australia in Melbourne or Sydney is seeking a Staff Data Engineer to shape data platforms for Payments. You will lead batch and streaming pipelines, mentor engineers and drive cloud-native data solutions across AWS services and Snowflake.

You’ll collaborate with architects, product teams and data consumers to set technical direction, improve data quality and reliability, and scale data capabilities for critical payment workflows.

Qualifications

• Experienced data engineer with deep technical capability and a track record of influencing engineering beyond your team.
• Strong experience with AWS data services (S3, EMR, Glue, Lambda, Redshift, SageMaker) and Snowflake.
• Proficiency in Python and PySpark for distributed data processing.
• Knowledge of batch and streaming pipelines using Airflow, Spark and Glue.
• Experience with CI/CD, automated testing and infrastructure-as-code; strong production reliability mindset.
• Strong SQL and relational database expertise.

Responsibilities

• Set technical direction for complex data engineering initiatives and influence architecture across squads.
• Design, build and evolve scalable batch and streaming data pipelines using Spark, Airflow and AWS Glue.
• Build cloud-native data solutions across AWS including S3, EMR, Glue, Lambda, Redshift and SageMaker.
• Engineer high-quality data products and evolve data platform and data marketplace patterns.
• Lead engineering practices across testing, CI/CD, infrastructure-as-code, observability and reliability.
• Establish patterns for data quality, resilience, performance and maintainability across workloads.
• Mentor engineers and partner with stakeholders to translate complex requirements into pragmatic solutions.

Skills

AWS data services

Snowflake

Python

PySpark

Batch and streaming pipelines

CI/CD

Observability

SQL

Tools

Airflow

Spark

AWS Glue

Amazon S3

Amazon EMR

Redshift

SageMaker

Job description

Commonwealth Bank of Australia in Melbourne or Sydney is seeking a Staff Data Engineer to shape data platforms for Payments. You will lead batch and streaming pipelines, mentor engineers and drive cloud-native data solutions across AWS services and Snowflake.

You’ll collaborate with architects, product teams and data consumers to set technical direction, improve data quality and reliability, and scale data capabilities for critical payment workflows.