Senior Data Engineer — Databricks/Snowflake Platform Lead

NCS Group Australia; City of Melbourne; On-site; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Paid parental leave

Well-being initiatives

Health insurance discounts

Product/service discounts

Recognition for high performance

AI-driven learning platform

Job summary

NCS Australia is seeking a highly skilled Senior Data Engineer to design, build, and optimise modern data platforms using Databricks or Snowflake in combination with dbt. You will lead architectural design, implement scalable data pipelines, and mentor junior engineers in a fast-paced environment in Melbourne.

Responsibilities include governance, CI/CD, and collaboration with analytics teams to deliver production-ready solutions and robust data models.

Qualifications

• Strong hands-on experience with Databricks (PySpark / Spark SQL) or Snowflake.
• Proficiency with dbt Core or dbt Cloud, including model development, testing, documentation, and deployment.
• Strong SQL development expertise, with experience working on complex transformations and performance tuning.
• Experience with cloud platforms (Azure, AWS, or GCP).
• Hands-on experience with version control (Git), CI/CD, and workflow orchestration tools (Airflow, Azure Data Factory, etc.).
• Understanding of medallion architecture, ELT patterns, and modular data modelling.
• Strong analytical and problem-solving capability.
• Excellent communication and strong stakeholder management skills.
• Proven ability to lead initiatives, work independently, and support decision-making across data projects.

Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks or Snowflake with dbt.
• Lead solution design across ingestion, storage, modelling, and consumption layers.
• Configure and optimise platform components including clusters, warehouses, permissions, and governance.
• Collaborate with cloud, analytics, and data science teams to deliver robust production-ready solutions.
• Manage vendor relationships and support data quality and data lineage frameworks.
• Automate testing and monitoring; drive continuous improvement through code reviews and engineering best practices.
• Mentor junior team members and lead data engineering initiatives.

Skills

Databricks

dbt

SQL

Cloud platforms

Git

CI/CD

Airflow

Medallion architecture

ELT

Data modelling

Analytical thinking

Stakeholder management

Tools

Databricks/PySpark

Snowflake

dbt Core/Cloud

Git

Airflow

Azure

AWS

GCP

Azure Data Factory

Job description

NCS Australia is seeking a highly skilled Senior Data Engineer to design, build, and optimise modern data platforms using Databricks or Snowflake in combination with dbt. You will lead architectural design, implement scalable data pipelines, and mentor junior engineers in a fast-paced environment in Melbourne.

Responsibilities include governance, CI/CD, and collaboration with analytics teams to deliver production-ready solutions and robust data models.