Senior Data Engineer

Talent Insights Group; City of Melbourne; On-site; AUD 120,000 - 180,000; Full time

Job summary

Talent Insights Group is assisting a leading Australian organisation in Melbourne undergoing a data and technology transformation. We are seeking a Senior Data Engineer for a 3–6 month contract to help shape the modern data platform.

You will design and deliver scalable data pipelines using Azure Databricks, ADLS and ADF, collaborating with stakeholders to translate requirements into robust solutions and accelerate value from data.

Qualifications

• Senior-level Data Engineer with hands-on production experience.
• Extensive experience with Azure Databricks, Azure Data Factory and ADLS.
• Strong SQL, Python, PySpark, and Databricks SQL skills.
• Experience building data warehouses, lakehouses and dimensional models.
• Familiarity with CI/CD, data governance and security.

Responsibilities

• Design and develop data engineering solutions across Microsoft Azure (Azure Databricks, ADF, ADLS).
• Build and maintain reliable, secure data pipelines.
• Develop data transformations using PySpark, Databricks SQL, SQL and Python.
• Onboard new data sources and partner data.
• Contribute to data lakehouse and data warehouse architecture.
• Collaborate with stakeholders to translate requirements into scalable solutions.
• Support data quality, performance, and production support.

Skills

Senior Data Engineer

Azure Databricks

Azure Data Factory

ADLS

PySpark

SQL

Python

Databricks SQL

Azure

Data pipelines

Tools

Azure DevOps

CI/CD

Job description

Our client is a leading Australian organisation undergoing an exciting period of data and technology transformation. They’re looking for a Senior Data Engineer to join their team on an initial 3–6 month contract, with the opportunity to make a genuine impact across their modern data platform.

You’ll play a key role in designing and delivering scalable data integration, analytics and reporting solutions, working across a modern Azure and Databricks environment.

The Role

You’ll be hands‑on across the data engineering lifecycle, taking ownership of data ingestion, transformation and modelling while helping evolve the organisation’s data architecture.

Key responsibilities include:

• Design and develop modern data engineering solutions across Microsoft Azure, with a strong focus on Azure Databricks, Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS)
• Build and maintain reliable, secure and high‑performing data pipelines
• Develop robust data transformations using PySpark, Databricks SQL, SQL and Python
• Design and implement curated analytical and dimensional data models
• Onboard and integrate new data sources and external partners
• Contribute to the evolution of lakehouse and data warehouse architecture
• Work closely with data engineers, analysts and business stakeholders to translate requirements into scalable technical solutions
• Support data quality, reliability and performance across production environments
• Contribute to CI/CD, data governance, security and engineering best practices
• Balance project delivery with BAU support and proactively resolve production issues

About You

We're looking for a senior-level Data Engineer who is comfortable working in a production environment and can hit the ground running.

You'll ideally have:

• Strong commercial experience as a Senior Data Engineer
• Extensive hands‑on experience with Azure Databricks, Azure Data Factory and ADLS
• Strong skills across SQL, Python, PySpark and Databricks SQL
• Experience building scalable data warehouses, lakehouses and dimensional data models
• Experience with Azure DevOps and CI/CD pipelines
• A strong understanding of data quality, performance, reliability and production support
• Experience integrating and onboarding new data sources
• The ability to work effectively with both technical and non‑technical stakeholders
• Strong communication skills and the confidence to take ownership of technical solutions
• An understanding of cloud security, access controls, data governance and analytics architecture

The Opportunity

• 3–6 month initial contract
• Opportunity to work on meaningful data transformation initiatives
• Senior‑level ownership and exposure across data engineering and architecture

If you're a Senior Data Engineer with strong Azure Databricks experience and you're available for a new contract opportunity in Melbourne, we'd love to hear from you.