Lead Data Engineer

MAP TALENT; Sydney; Hybrid; AUD 123,984 - 151,536; Full time

Job summary

A leading recruitment firm is seeking a Senior Data Engineer to join a well-established superannuation business in Sydney. This role, on a 12-month contract, focuses on developing a new data platform using Databricks on Azure. Candidates should have extensive experience in data engineering, particularly with Azure technologies and a background in regulated industries. Hybrid working arrangements available.

Qualifications

• Must have commercial experience using Databricks.
• Strong hands-on experience with Databricks, Azure Data Lake, and Azure Data Factory.
• Solid background in Python and SQL for data engineering.
• Experience building data pipelines in a cloud environment (Azure).
• Good understanding of Delta Lake, data governance, and platform architecture.
• Prior experience working in regulated industries, ideally financial services or superannuation.

Responsibilities

• Migrating legacy data processes and models into a modern lakehouse architecture.
• Working closely with a team of data engineers to help upgrade and enhance the existing data platform.
• Creating robust CI/CD pipelines.
• Supporting the internal team with uplift and documentation as part of knowledge transfer.

Skills

Databricks

Azure Data Lake

Azure Data Factory

Python

SQL

Delta Lake

Data governance

Job description

Direct message the job poster from MAP TALENT

Connecting the best data talent to businesses in Australia Data Recruiter Tennis Enthusiast Co-Founder of The Data Map…

Location: North Sydney (Hybrid)

Duration: 12-month Day Rate Contract

We’re working with a well-established superannuation business that’s investing heavily in modernising their data platform.

As part of this transformation, they’re looking for a Senior Data Engineer to join the team on a 6-month contract to help create a brand new greenfield data platform in Databricks on Azure.

The aim is to bring AI to the forefront of the business however, the foundations need to be laid out in place first before enabling AI throughout the business.

Responsibilities:

• Migrating legacy data processes and models into a modern lakehouse architecture
• Working closely with a team of data engineers to help upgrade and enhance the existing data platform.
• Creating robust CI/CD pipelines.
• Supporting the internal team with uplift and documentation as part of knowledge transfer

Requirements:

• Must have commercial experience using Databricks
• Strong hands-on experience with Databricks, Azure Data Lake, and Azure Data Factory
• Solid background in Python and SQL for data engineering
• Experience building data pipelines in a cloud environment (Azure)
• Good understanding of Delta Lake, data governance, and platform architecture
• Prior experience working in regulated industries, ideally financial services or superannuation

Next steps:

1 stage interview process involving a technical deep dive discussion.

Aim is End of August/Early Sept.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology

• Industries

  Financial Services and IT Services and IT Consulting

Referrals increase your chances of interviewing at MAP TALENT by 2x

Get notified about new Data Engineer jobs in Sydney, New South Wales, Australia.

Sydney, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 6 days ago

Sydney, New South Wales, Australia 1 month ago

Sydney, New South Wales, Australia 6 days ago

Sydney, New South Wales, Australia 1 day ago

Sydney, New South Wales, Australia 2 hours ago

Sydney, New South Wales, Australia 2 hours ago

Sydney, New South Wales, Australia 2 months ago

Sydney, New South Wales, Australia 3 weeks ago

Sydney, New South Wales, Australia 2 weeks ago

Chippendale, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 2 days ago

Sydney, New South Wales, Australia A$90.00-A$110.00 2 weeks ago

Data Engineer with BI Capability (12-Month Maximum Term Contract)

Haymarket, New South Wales, Australia 1 day ago

Sydney, New South Wales, Australia 5 days ago

Sydney, New South Wales, Australia 2 days ago

Sydney, New South Wales, Australia 21 hours ago

Sydney, New South Wales, Australia 19 hours ago

Sydney, New South Wales, Australia 3 weeks ago

Sydney, New South Wales, Australia 6 days ago

Millers Point, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 2 days ago

Millers Point, New South Wales, Australia 1 week ago

Sydney, New South Wales, Australia 1 month ago

Sydney, New South Wales, Australia 5 days ago

Sydney, New South Wales, Australia 20 hours ago

Sydney, New South Wales, Australia A$70.00-A$80.00 3 days ago

Sydney, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 4 weeks ago

Chatswood, New South Wales, Australia 6 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.