Senior Data Engineer – Test Data Management

NAB; City of Melbourne; On-site; AUD 140,000 - 190,000; Full time

Job summary

NAB is seeking a Senior Data Engineer to shape secure, automated data solutions in the Core Engineering Team. You’ll develop scalable Python services, build data pipelines using PySpark, and deploy on AWS and Azure to ensure reliability and performance.

You’ll work with stakeholders to design effective technology solutions, maintain ETL processes, and support CI/CD practices while documenting deployment guides and runbooks.

Qualifications

• Hands-on Python development in daily delivery.
• Solid understanding of cloud environments (AWS/Azure).
• Designing and optimising SQL for data manipulation and analysis.
• Data pipelines, ETL processes and distributed computing.
• CI/CD tooling (Jenkins or similar) and shell scripting.
• PySpark and EMR experience is a plus.
• Data masking or data privacy tooling is highly desirable.

Responsibilities

• Develop, enhance and maintain scalable applications, automation solutions and operational tooling using Python, following coding standards, best practices and reusable design principles.
• Build, deploy and support cloud-based applications and services across AWS and Azure for scalability, security, reliability and performance.
• Develop and maintain ETL processes, data pipelines and data integration using PySpark and EMR where applicable.
• Support CI/CD practices and software delivery processes for reliable releases.
• Create and maintain technical documentation, deployment guides and runbooks.
• Partner with stakeholders to gather requirements and design effective technology solutions.
• Proactively manage risk and ensure compliance; adhere to processes and procedures.

Skills

Python

PySpark

SQL

Cloud AWS/Azure

Data pipelines

CI/CD tooling

Shell scripting

EMR

Data masking

Communication

Tools

Jenkins

Job description

Shape the future of test data at NAB. Turn complex challenges into secure, automated solutions using Python, PySpark and SQL across AWS and Azure.

• Shape the future of test data with secure, automated cloud solutions.
• Build self-service tools that give teams faster access to the data they need.
• Own solutions end to end and lift reliability, performance and compliance.

Our people are customer obsessed. They prioritise the needs and satisfaction of the customer above all else. Our mindset fosters innovation and creates strong, lasting customer relationships as we strive to be the most customer centric company in Australia and New Zealand.

In this Senior Data Engineer , role you will join the Core Engineering Team within Tech Modernisation that’s doubling down on customer obsession.

Each day, you’ll make an impact by:

• Develop, enhance and maintain scalable applications, automation solutions and operational tooling using Python, following coding standards, best practices and reusable design principles
• Build, deploy and support cloud-based applications and services across AWS and Azure, leveraging cloud-native capabilities to ensure scalability, security, reliability and performance
• Develop and maintain ETL processes, data pipelines and data integration solutions, including processing and analysis of large datasets using distributed computing technologies such as PySpark and Amazon EMR where applicable
• Support CI/CD practices and software delivery processes to enable efficient, reliable and high-quality releases
• Create and maintain technical documentation, deployment guides, operational procedures and support runbooks
• Partner with technical and business stakeholders to gather requirements, provide technical recommendations and design effective technology solutions
• Proactively manage risk; meet all policy and compliance requirements; perform controls; adhere to Process and Procedures pertinent to role; and escape events, issues or breaches as they are identified (risk accountability forms part of all roles, as everyone is responsible for managing risk and compliance)

What you’ll bring:

• Hands-on Python development as part of day-to-day delivery
• Solid understanding of cloud environments and how to use them effectively, including AWS and/or Azure
• Designing and optimising SQL for data manipulation and analysis
• Data pipelines, ETL processes and distributed computing
• CI/CD tooling (Jenkins or similar) and shell scripting
• PySpark and working experience in EMR environments (a plus, not mandatory)
• Test data management, data masking or data privacy tooling (highly desirable)
• Develop and maintain ETL processes, data pipelines and data integration solutions
• Good communication and presentation skills across technical and non-technical audiences

We respectfully ask candidates to hold any questions for the phone interview, where we’ll discuss the role in detail and answer any questions. This helps to ensure a focussed, efficient and fair application process. The talent acquisition team looks forward to addressing all inquiries at that time if your application progresses.

A diverse and inclusive workplace works better for everyone

We know that our people make us who we are. That's why we have built a culture of equity and respect – where everyone feels valued and appreciated for being their authentic selves. In partnership with our multiple Employee Resource Groups (ERGs) we continue to foster an inclusive environment, where all NAB colleagues’ unique backgrounds and identities are understood, respected and celebrated.

Build your career with NAB

At NAB, we encourage our colleagues to invest in their skills, experiences and careers. To put your best application forward, we recommend firstly reviewing the job advertisement and the Role Purpose Statement (also known as the position description – this is linked to the job advert). This will give you a clear idea of what the role entails. If the opportunity excites you and aligns with your career aspirations, you should seek your People Leader’s endorsement and apply.

Note: all NAB colleagues are encouraged to have a minimum of 18 months tenure in their current role.

Looking for career advice?

We’re excited about your interest in this opportunity! For personalised career advice and to discuss your growth within NAB, please speak with your People Leader. They know your journey best and can offer the most relevant support and guidance. Additionally, please visit CareerU or Careers at NAB for useful tips and tools. Our Talent Acquisition Consultants are dedicated to the hiring process and will not have the full picture of your career path.

We wish you the best of luck with your application! Application updates will be shared with you from PageUp (our recruitment system). We recommend you filter our current opportunities to your preferred location before applying. If you require any adjustments to the recruitment process or the role, please let the Talent Acquisition Consultant know.