Senior Data Engineer (DBT and Databricks/Snowflake)

NCS Group Australia; City of Melbourne; On-site; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Paid parental leave

Well-being initiatives

Health insurance discounts

Product/service discounts

Recognition for high performance

AI-driven learning platform

Job summary

NCS Australia is seeking a highly skilled Senior Data Engineer to design, build, and optimise modern data platforms using Databricks or Snowflake in combination with dbt. You will lead architectural design, implement scalable data pipelines, and mentor junior engineers in a fast-paced environment in Melbourne.

Responsibilities include governance, CI/CD, and collaboration with analytics teams to deliver production-ready solutions and robust data models.

Qualifications

• Strong hands-on experience with Databricks (PySpark / Spark SQL) or Snowflake.
• Proficiency with dbt Core or dbt Cloud, including model development, testing, documentation, and deployment.
• Strong SQL development expertise, with experience working on complex transformations and performance tuning.
• Experience with cloud platforms (Azure, AWS, or GCP).
• Hands-on experience with version control (Git), CI/CD, and workflow orchestration tools (Airflow, Azure Data Factory, etc.).
• Understanding of medallion architecture, ELT patterns, and modular data modelling.
• Strong analytical and problem-solving capability.
• Excellent communication and strong stakeholder management skills.
• Proven ability to lead initiatives, work independently, and support decision-making across data projects.

Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks or Snowflake with dbt.
• Lead solution design across ingestion, storage, modelling, and consumption layers.
• Configure and optimise platform components including clusters, warehouses, permissions, and governance.
• Collaborate with cloud, analytics, and data science teams to deliver robust production-ready solutions.
• Manage vendor relationships and support data quality and data lineage frameworks.
• Automate testing and monitoring; drive continuous improvement through code reviews and engineering best practices.
• Mentor junior team members and lead data engineering initiatives.

Skills

Databricks

dbt

SQL

Cloud platforms

Git

CI/CD

Airflow

Medallion architecture

ELT

Data modelling

Analytical thinking

Stakeholder management

Tools

Databricks/PySpark

Snowflake

dbt Core/Cloud

Git

Airflow

Azure

AWS

GCP

Azure Data Factory

Job description

We are NCS Australia! We have brought together Australia’s best tech talent, working as one to harness technology and advance our communities, to make the extraordinary happen.

We're proud of our rich history of partnering with our clients to develop end to end digital technology solutions to accelerate their transformation and innovation journey. For over 40+ years our diverse global teams have delivered large-scale, mission-critical, multi-platform projects to governments and enterprises.

About us

We are NCS Australia! We have brought together Australia’s best tech talent, working as one to harness technology and advance our communities, to make the extraordinary happen.

We're proud of our rich history of partnering with our clients to develop end to end digital technology solutions to accelerate their transformation and innovation journey. For over 40+ years our diverse global teams have delivered large-scale, mission-critical, multi-platform projects to governments and enterprises.

Job Description

We are seeking a highly skilled Senior Data Engineer with deep experience in Databricks or Snowflake and strong hands‑on capability with dbt to lead the design, development, and optimisation of modern data platforms. The ideal candidate will bring strong technical leadership, the ability to build scalable data pipelines, and experience shaping enterprise‑grade data solutions that support analytics, reporting, and advanced modelling.

In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and transformation workflows using Databricks or Snowflake in combination with dbt, ensuring high performance, reliability, and strong engineering standards across the data platform. You will lead solution design efforts, contributing to architecture across ingestion, storage, modelling, and consumption layers while implementing modern data engineering patterns such as ELT, medallion architecture, and CI/CD-enabled development. You will configure and optimise platform components including clusters, warehouses, permissions, and governance frameworks, and collaborate closely with cloud, analytics, and data science teams to deliver robust, production‑ready solutions. The role also includes managing vendor relationships, supporting data quality and lineage frameworks, automating testing and monitoring, and driving continuous improvement through code reviews, engineering best practices, and mentorship of junior team members.

Qualifications

• Strong hands‑on experience with Databricks (PySpark / Spark SQL) or Snowflake.
• Proficiency with dbt Core or dbt Cloud, including model development, testing, documentation, and deployment.
• Strong SQL development expertise, with experience working on complex transformations and performance tuning.
• Experience with cloud platforms (Azure, AWS, or GCP).
• Hands‑on experience with version control (Git), CI/CD, and workflow orchestration tools (Airflow, Azure Data Factory, etc.).
• Understanding of medallion architecture, ELT patterns, and modular data modelling.
• Strong analytical and problem‑solving capability.
• Excellent communication and strong stakeholder management skills.
• Proven ability to lead initiatives, work independently, and support decision‑making across data projects.

Additional Information

Why join us

NCS Australia is where you can feel at home, nurturing your talents and skills as we make tomorrow together, one day at a time.

• paid parental leave
• initiatives focused on your well‑being
• discounted health insurance
• discounts on various products and services
• regularly recognised and rewarded for high performance
• Capability Fingerprint, industry and partner training programs, special interest groups, and an AI-driven learning platform

No matter where you are in your career, we offer meaningful work and opportunities for growth.

NCS Australia is an equal‑opportunity employer, and we take pride in our commitment to valuing and supporting our people and the communities we serve.

We are dedicated to attracting, retaining and developing our people regardless of gender identity, ethnicity, sexual orientation, disability and age.

Applications are encouraged from all sectors of the community and we strongly encourage applications from the Veterans, Aboriginal and/or Torres Strait Islander community.

At NCS Australia, we are committed to supporting adjustments throughout the recruitment and selection process, as well as during employment.

We actively support and encourage people with disability to apply.

Work rights and background checks

To be eligible for a position with us, applicants will need to have valid work rights for Australia and be willing to undergo a comprehensive background checking process, including probity and police checks.