Senior Data Engineer

Bailey Abbott Pty Ltd; City of Unley; On-site; AUD 150,000 - 210,000; Full time

Job summary

Bailey Abbott Pty Ltd is seeking a Senior Data Engineer to lead architectural decisions and own data pipelines across modern cloud platforms. The role requires strong SQL, Python or Scala, and data modelling capabilities, with focus on governance and scalable design.

You will mentor junior engineers, collaborate with stakeholders, and deliver secure, observable data solutions using Azure, Snowflake, and Databricks in a fast-paced environment.

Qualifications

• Strong SQL skills with advanced query optimisation and data pipeline design.
• Proficiency in Python or Scala for data pipelines.
• Solid data modelling ability (dimensional modelling, star/snowflake schemas).
• Knowledge of data governance, lineage and security, and scalable pipelines.
• Experience mentoring junior/mid-level engineers.
• Hands-on with Azure as a cloud platform.
• Proficiency with ETL/ELT and orchestration tools like dbt or Azure Data Factory.
• Experience with data warehouses (Snowflake, BigQuery, Redshift, Synapse).
• Exposure to Databricks or Fabric, IaC (Terraform), and CI/CD (Git).
• Experience with data quality observability and some MLOps exposure.

Skills

SQL optimization

Python

Scala

Data modelling

Data governance

Stakeholder comms

Mentoring

Databricks

Snowflake

BigQuery

Redshift

Synapse

CI/CD

Git

Terraform

dbt

Azure

Tools

Azure Data Factory

dbt

Terraform

Git

Job description

Our Company

We exist to bring amazing people together to explore the art of possible.

Bailey Abbott are a progressive and dynamic IT Consultancy business working across both Public and Private sectors. People are at the core of everything we do. We’re all about nurturing and inspiring people – ours and our clients. We bring a positive attitude and mindset to everything we do. We confidently use our knowledge and skills to solve problems, finding a better and easier way forward.

We deliver transformational outcomes to take businesses further, fearlessly. Confidence and trust is fundamental to delivering superior outcomes and we take ownership and responsibility for our commitments.

Our People

Our staff are creative, collaborative, and passionate. We’re strong advocates for change, challenging the status quo through new thinking, technology, and practices. Always exploring creative ways to simplify complexity.

Role Overview

We are seeking a Senior Data Engineer with a demonstrated track record of leading technical design decisions and owning architecture outcomes.

Required Skills & Experience

• Strong SQL skills including advanced query optimisation, along with proficiency in Python or Scala for data pipeline development.
• Solid data modelling capability (dimensional modelling, star/snowflake schemas, normalisation).
• Strong understanding of data governance, lineage and security, and the ability to design scalable, well-architected data pipelines.
• Strong stakeholder communication skills.
• Ability to translate technical trade-offs for non-technical audiences.
• Previous experience of mentoring junior and mid-level engineers.
• Hands‑on experience with a major cloud platform is required (most common Azure).
• Proficiency with ETL/ELT and orchestration tools such as dbt, or Azure Data Factory.
• Experience with modern data warehousing platforms including Snowflake, BigQuery, Redshift, or Synapse.
• Exposure to big data frameworks such as Databricks or Fabric, infrastructure-as-code tools like Terraform, and CI/CD pipelines using Git and DevOps.
• Experience with data quality frameworks and observability/monitoring tooling, along with some exposure to MLOps or AI/ML pipeline support.

Desirable Skills

• Previous experience working with government clients would be beneficial.

Clearance requirements

• Australian citizenship required.

Our clients are diverse and so are we. We engage with great talent from all walks of life to bring their extensive and varied experience to help promote innovation. We encourage applications from candidates from all backgrounds to further strengthen Bailey Abbott.

Bailey Abbott. Explore Possible.