Hybrid Data Engineer — Azure, Databricks & CI/CD

Transport for NSW; Sydney; On-site; AUD 142,000 - 159,000; Full time

Benefits offered by this job

Flexible work options

Job summary

Transport for NSW is seeking a hands-on Data Engineer to build and maintain a cloud-based data platform that underpins reporting, analytics, and decision-making for NSW infrastructure programs.

You will design and implement data pipelines and models, ensure data quality and security, and contribute to DevOps and CI/CD practices while collaborating across teams to deliver scalable, reliable data solutions for customers and stakeholders in Sydney and beyond.

Qualifications

• Hands-on experience with Azure Data Factory (ADF) and Databricks.
• Strong programming and scripting skills in SQL and Python.
• Demonstrated experience in designing databases and developing data models.
• Experience in data cleansing, transformation, and pipeline management.
• Experience supporting DevOps and CI/CD platforms and practices.
• The ability to troubleshoot technical issues and maintain platform performance.
• Strong collaboration and communication skills, with a commitment to continuous improvement.

Responsibilities

• Design, develop, test, and support data pipelines, data models, and cloud-based infrastructure.
• Work across the full data engineering lifecycle, including data integration, transformation, automation, CI/CD, and platform maintenance.
• Maintain a trusted data platform that serves as a single source of truth for reporting and decision-making.
• Contribute to asset performance, project delivery, and operational outcomes through reliable data.

Skills

SQL

Python

Data modeling

Data cleansing

CI/CD

Troubleshooting

Collaboration

Tools

Azure Data Factory

Databricks

Job description

Transport for NSW is seeking a hands-on Data Engineer to build and maintain a cloud-based data platform that underpins reporting, analytics, and decision-making for NSW infrastructure programs.

You will design and implement data pipelines and models, ensure data quality and security, and contribute to DevOps and CI/CD practices while collaborating across teams to deliver scalable, reliable data solutions for customers and stakeholders in Sydney and beyond.