Technical Lead - Data Engineering

Latitude IT; Sydney; On-site; AUD 140,000 - 170,000; Full time

Job summary

Latitude IT is searching for a Lead Data Engineer to spearhead the architectural design of an innovative data platform powered by Azure technologies. In this role, you will guide a talented team in data engineering practices, ensuring high-quality and efficient data solutions that will enable advanced analytics and machine learning initiatives across the organization.

Qualifications

• 10+ years of experience in data engineering or software development roles.
• Deep, hands-on experience with Azure Data Lake, Synapse, Azure SQL, and Spark/PySpark.
• Solid understanding of data architecture concepts including lakehouse patterns.

Responsibilities

• Lead architecture and evolution of a modern data platform on Azure.
• Design and implement robust data pipelines for data solutions.
• Mentor a team of data engineers and provide technical oversight.

Skills

Data Engineering

Azure Data Services

Python

SQL

Infrastructure-as-Code

CI/CD Pipeline

Job description

2 days ago Be among the first 25 applicants

Direct message the job poster from Latitude IT

Recruitment Specialist - Data & Analytics Practice

We’re partnering with a leading insurer undergoing major digital transformation to find a Lead Data Engineer with deep expertise in Azure and a passion for building scalable, intelligent data solutions.

This is your opportunity to drive cloud-first data engineering practices and lead the development of a best-in-class data platform powering analytics, reporting, and machine learning across the enterprise.

What You’ll Be Doing:

• Lead the architecture and evolution of a modern data platform built on Azure cloud technologies
• Design and implement robust data pipelines, ensuring they’re modular, testable, and reusable
• Define and champion engineering best practices across the data lifecycle, from ingestion to consumption
• Mentor a team of data engineers and provide technical oversight across internal and partner teams
• Drive improvements in code quality, monitoring, deployment, and infrastructure automation
• Collaborate with architects, analysts, and stakeholders to deliver trusted, high-quality data assets
• Lead initiatives around data modelling, metadata, governance, and lineage visibility

What We’re Looking For:

• 10+ years of experience in data engineering or software development roles
• Deep, hands-on experience with Azure data services including Azure Data Lake, Synapse, Azure SQL, and Spark/PySpark
• Solid understanding of data architecture concepts including lakehouse patterns, star/snowflake schema, and dimensional modelling
• Strong skills in Python, SQL, and infrastructure-as-code (e.g., YAML, Bicep)
• Experience deploying data solutions using CI/CD pipelines and DevOps practices
• Ability to lead complex data initiatives, influence engineering decisions, and guide technical teams
• Bonus points for exposure to MLOps, data observability tools, and insurance or financial services

Why You’ll Love This Role

• Be a key player in a large-scale data modernisation journey
• Join a skilled, tight-knit data team with a strong engineering culture
• Make a real impact by shaping the tools, processes, and standards used across the enterprise
• Work for an organisation committed to innovation, inclusion, and doing meaningful work

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Information Services

Referrals increase your chances of interviewing at Latitude IT by 2x

Get notified about new Engineering Technician jobs in Sydney, New South Wales, Australia.

E&I Technician (EEHA) - Ongoing Maintenance Works - Sydney

Sydney, New South Wales, Australia 1 month ago

Sydney, New South Wales, Australia 6 days ago

High Voltage Electrical Testing Technician High Voltage Electrical Testing Technician - Sydney

Sydney, New South Wales, Australia 2 weeks ago

Service Technician (Electrical and/or Mechanical)

Sydney, New South Wales, Australia 1 day ago

Sydney, New South Wales, Australia 1 month ago

Ingleburn, New South Wales, Australia 1 month ago

Sydney, New South Wales, Australia 2 months ago

Wetherill Park, New South Wales, Australia 1 week ago

Sydney, New South Wales, Australia 2 weeks ago

Huntingwood, New South Wales, Australia 1 week ago

Sydney, New South Wales, Australia 1 day ago

Mascot, New South Wales, Australia 18 hours ago

Sydney, New South Wales, Australia A$140,000.00-A$170,000.00 2 days ago

Sydney, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 3 months ago

Sydney, New South Wales, Australia 4 weeks ago

Sydney, New South Wales, Australia 1 month ago

Sydney, New South Wales, Australia 1 month ago

Sydney, New South Wales, Australia 2 weeks ago

Maintenance Technician (Moulding) - Night Shift

Sydney, New South Wales, Australia 4 weeks ago

Eastern Creek, New South Wales, Australia 2 days ago

Moorebank, New South Wales, Australia 1 day ago

Regents Park, New South Wales, Australia 1 month ago

Horsley Park, New South Wales, Australia 2 days ago

Biomedical Engineering Technical Officer (Electronics) - REQ581104

Kemps Creek, New South Wales, Australia 5 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.