Senior Data Engineer: Test Data Automation & Cloud ETL

National Australia Bank; Sydney; On-site; AUD 140,000 - 190,000; Full time

Job summary

National Australia Bank (NAB) is seeking a Senior Data Engineer to join the Core Engineering Team within Tech Modernisation. You will build scalable cloud-based data solutions using Python, PySpark, SQL, and distributed computing across AWS and Azure.

You’ll own end-to-end data pipelines and tooling, ensuring reliability, security and performance. Daily work includes developing ETL processes, supporting CI/CD, documenting deployment guides, and collaborating with business stakeholders to design

Qualifications

• Hands-on Python development in delivery roles.
• Experience with cloud environments AWS/Azure.
• Strong SQL for data manipulation and analysis.
• Experience building data pipelines and ETL processes.
• CI/CD tooling experience (e.g., Jenkins).
• Experience with PySpark and EMR is a plus.
• Knowledge of data privacy tooling is desirable.
• Excellent communication across technical and non-technical audiences.

Responsibilities

• Develop, enhance and maintain scalable applications and tooling using Python.
• Build, deploy and support cloud-based apps across AWS and Azure.
• Develop and maintain ETL processes and data pipelines using distributed computing.
• Support CI/CD practices for reliable releases.
• Create deployment guides and runbooks.
• Partner with stakeholders to design technology solutions.
• Proactively manage risk and ensure compliance.

Skills

Python development

Cloud platforms AWS/Azure

SQL optimization

Data pipelines

ETL processes

PySpark

CI/CD tooling

Shell scripting

Data privacy tooling

Communication skills

Tools

Jenkins

AWS EMR

Job description

National Australia Bank (NAB) is seeking a Senior Data Engineer to join the Core Engineering Team within Tech Modernisation. You will build scalable cloud-based data solutions using Python, PySpark, SQL, and distributed computing across AWS and Azure.

You’ll own end-to-end data pipelines and tooling, ensuring reliability, security and performance. Daily work includes developing ETL processes, supporting CI/CD, documenting deployment guides, and collaborating with business stakeholders to design