Senior Data Engineer: Lead Architecture & Cloud Pipelines

Bailey Abbott Pty Ltd; South Australia; Ibrido; AUD 150.000 - 190.000; Tempo pieno

Descrizione del lavoro

Bailey Abbott Pty Ltd is seeking a Senior Data Engineer to lead design decisions and own the data architecture across client engagements. You will design scalable data pipelines, ensure governance and security, and mentor junior engineers.

The role requires strong SQL and Python/Scala skills, hands-on Azure cloud experience, and expertise with modern data warehousing platforms and orchestration tools. Collaboration with stakeholders is essential.

Competenze

• Strong SQL and Python/Scala for data pipelines.
• Dimensional modelling and data warehousing design.
• Knowledge of data governance, lineage and security.
• Ability to mentor junior/mid-level engineers.
• Hands-on with Azure cloud platform.
• Proficiency with ETL/ELT and orchestration tools (dbt, ADF).
• Experience with modern data warehousing platforms (Snowflake, BigQuery, Redshift or Synapse).
• Exposure to data quality, observability, and ML/AI pipeline support.

Mansioni

• Lead technical design decisions and own architecture outcomes.
• Translate technical trade-offs for stakeholders.
• Mentor junior engineers and review code and designs.
• Design scalable, secure data pipelines and architectures.
• Collaborate with data scientists and analytics teams to deliver value.

Conoscenze

SQL proficiency

Python/Scala

Data modelling

Cloud platform experience

ETL/ELT orchestration

Data governance

Stakeholder communication

Mentoring

Strumenti

dbt

Azure Data Factory

Snowflake/BigQuery/Redshift

Git & CI/CD

Terraform

Databricks

Descrizione del lavoro

Our Company

We exist to bring amazing people together to explore the art of possible.

Bailey Abbott are a progressive and dynamic IT Consultancy business working across both Public and Private sectors. People are at the core of everything we do. We’re all about nurturing and inspiring people – ours and our clients. We bring a positive attitude and mindset to everything we do. We confidently use our knowledge and skills to solve problems, finding a better and easier way forward.

We deliver transformational outcomes to take businesses further, fearlessly. Confidence and trust is fundamental to delivering superior outcomes and we take ownership and responsibility for our commitments.

Our People

Our staff are creative, collaborative, and passionate. We’re strong advocates for change, challenging the status quo through new thinking, technology, and practices. Always exploring creative ways to simplify complexity.

Role Overview

We are seeking a Senior Data Engineer with a demonstrated track record of leading technical design decisions and owning architecture outcomes.

Required Skills & Experience

• Strong SQL skills including advanced query optimisation, along with proficiency in Python or Scala for data pipeline development.
• Solid data modelling capability (dimensional modelling, star/snowflake schemas, normalisation).
• Strong understanding of data governance, lineage and security, and the ability to design scalable, well-architected data pipelines.
• Strong stakeholder communication skills.
• Ability to translate technical trade-offs for non-technical audiences.
• Previous experience of mentoring junior and mid-level engineers.
• Hands-on experience with a major cloud platform is required (most common Azure).
• Proficiency with ETL/ELT and orchestration tools such as dbt, or Azure Data Factory.
• Experience with modern data warehousing platforms including Snowflake, BigQuery, Redshift, or Synapse.
• Exposure to big data frameworks such as Databricks or Fabric, infrastructure-as-code tools like Terraform, and CI/CD pipelines using Git and DevOps.
• Experience with data quality frameworks and observability/monitoring tooling, along with some exposure to MLOps or AI/ML pipeline support.

Desirable Skills

• Previous experience working with government clients would be beneficial.

Clearance requirements

• Australian citizenship required.

Our clients are diverse and so are we. We engage with great talent from all walks of life to bring their extensive and varied experience to help promote innovation. We encourage applications from candidates from all backgrounds to further strengthen Bailey Abbott.

Bailey Abbott. Explore Possible.