Senior Data Engineer – Test Data Management

National Australia Bank; Sydney; On-site; AUD 140,000 - 190,000; Full time

Job summary

National Australia Bank (NAB) is seeking a Senior Data Engineer to join the Core Engineering Team within Tech Modernisation. You will build scalable cloud-based data solutions using Python, PySpark, SQL, and distributed computing across AWS and Azure.

You’ll own end-to-end data pipelines and tooling, ensuring reliability, security and performance. Daily work includes developing ETL processes, supporting CI/CD, documenting deployment guides, and collaborating with business stakeholders to design

Qualifications

• Hands-on Python development in delivery roles.
• Experience with cloud environments AWS/Azure.
• Strong SQL for data manipulation and analysis.
• Experience building data pipelines and ETL processes.
• CI/CD tooling experience (e.g., Jenkins).
• Experience with PySpark and EMR is a plus.
• Knowledge of data privacy tooling is desirable.
• Excellent communication across technical and non-technical audiences.

Responsibilities

• Develop, enhance and maintain scalable applications and tooling using Python.
• Build, deploy and support cloud-based apps across AWS and Azure.
• Develop and maintain ETL processes and data pipelines using distributed computing.
• Support CI/CD practices for reliable releases.
• Create deployment guides and runbooks.
• Partner with stakeholders to design technology solutions.
• Proactively manage risk and ensure compliance.

Skills

Python development

Cloud platforms AWS/Azure

SQL optimization

Data pipelines

ETL processes

PySpark

CI/CD tooling

Shell scripting

Data privacy tooling

Communication skills

Tools

Jenkins

AWS EMR

Job description

Shape the future of test data at NAB. Turn complex challenges into secure, automated solutions using Python, PySpark and SQL across AWS and Azure.

• Shape the future of test data with secure, automated cloud solutions.
• Build self-service tools that give teams faster access to the data they need.
• Own solutions end to end and lift reliability, performance and compliance.

Our people are customer obsessed. They prioritise the needs and satisfaction of the customer above all else. Our mindset fosters innovation and creates strong, lasting customer relationships as we strive to be the most customer centric company in Australia and New Zealand.

In this Senior Data Engineer , role you will join the Core Engineering Team within Tech Modernisation that’s doubling down on customer obsession.

Each day, you’ll make an impact by:

• Develop, enhance and maintain scalable applications, automation solutions and operational tooling using Python, following coding standards, best practices and reusable design principles
• Build, deploy and support cloud-based applications and services across AWS and Azure, leveraging cloud-native capabilities to ensure scalability, security, reliability and performance
• Develop and maintain ETL processes, data pipelines and data integration solutions, including processing and analysis of large datasets using distributed computing technologies such as PySpark and Amazon EMR where applicable
• Support CI/CD practices and software delivery processes to enable efficient, reliable and high-quality releases
• Create and maintain technical documentation, deployment guides, operational procedures and support runbooks
• Partner with technical and business stakeholders to gather requirements, provide technical recommendations and design effective technology solutions
• Proactively manage risk; meet all policy and compliance requirements; perform controls; adhere to Process and Procedures pertinent to role; and elevate events, issues or breaches as they are identified (risk accountability forms part of all roles, as everyone is responsible for managing risk and compliance)

What you’ll bring:

• Hands-on Python development as part of day-to-day delivery
• Solid understanding of cloud environments and how to use them effectively, including AWS and/or Azure
• Designing and optimising SQL for data manipulation and analysis
• Data pipelines, ETL processes and distributed computing
• CI/CD tooling (Jenkins or similar) and shell scripting
• PySpark and working experience in EMR environments (a plus, not mandatory)
• Test data management, data masking or data privacy tooling (highly desirable)
• Develop and maintain ETL processes, data pipelines and data integration solutions
• Good communication and presentation skills across technical and non-technical audiences

A diverse and inclusive workplace works better for everyone

We know that our people make us who we are. That's why we have built a culture of equity and respect – where everyone feels valued and appreciated for being their authentic selves. In partnership with our multiple Employee Resource Groups (ERGs) we continue to foster an inclusive environment, where all NAB colleagues’ unique backgrounds and identities are understood, respected and celebrated.

Build your career with NAB

At NAB, we encourage our colleagues to invest in their skills, experiences and careers. To put your best application forward, we recommend firstly reviewing the job advertisement and the Role Purpose Statement (also known as the position description – this is linked to the job advert). This will give you a clear idea of what the role entails. If the opportunity excites you and aligns with your career aspirations, you should seek your People Leader’s endorsement and apply.

Note: all NAB colleagues are encouraged to have a minimum of 18 months tenure in their current role.

Looking for career advice?

We’re excited about your interest in this opportunity! For personalised career advice and to discuss your growth within NAB, please speak with your People Leader. They know your journey best and can offer the most relevant support and guidance. Additionally, please visit CareerU or Careers at NAB for useful tips and tools. Our Talent Acquisition Consultants are dedicated to the hiring process and will not have the full picture of your career path.

We wish you the best of luck with your application! Application updates will be shared with you from PageUp (our recruitment system). We recommend you filter our current opportunities to your preferred location before applying. If you require any adjustments to the recruitment process or the role, please let the Talent Acquisition Consultant know.

#LI-DNI