Lead Data Engineer

XPT Software Australia Pty Ltd; City of Melbourne; On-site; AUD 170,000 - 240,000; Full time

Job summary

XPT Software Australia Pty Ltd is seeking a Lead Data Engineer to drive strategy, architecture, delivery, and optimization of enterprise-scale data platforms on Microsoft Azure. The role blends deep technical expertise with leadership, governance, and stakeholder management to build secure, scalable data solutions for major clients.

You will mentor teams, guide data pipelines, models, and lakehouse architectures, while championing cloud cost optimization and DevOps practices across delivery

Qualifications

• 10+ years IT experience, including 10+ years in Data Engineering.
• Minimum 5+ years of leadership experience managing large Data Engineering programs.
• Proven track record leading cross-functional, multi-vendor teams.
• Strong stakeholder management, delivery governance, and executive communication.

Responsibilities

• Lead end-to-end delivery of enterprise data platforms, including architecture, development, deployment and optimization.
• Define the data platform roadmap and align with business objectives.
• Architect and govern scalable data pipelines, models, warehouses, and lakehouse solutions on Azure.
• Provide technical leadership through design/code reviews and best-practice adoption.
• Drive adoption of Microsoft Fabric, APIs, Azure Functions and Python-based solutions.
• Ensure scalability, security, reliability and cost optimization of cloud data platforms.
• Establish data governance, quality, security and compliance standards.
• Implement CI/CD, DevOps and Agile practices; collaborate with stakeholders to translate requirements.

Skills

SQL

Python

PySpark

Azure Data Factory

Azure Synapse Analytics

Delta Lake

Data Modeling

Data Warehousing

Microsoft Fabric

CI/CD / DevOps

GitHub Copilot

Tools

Azure Data Factory (ADF)

Azure Synapse Analytics

Delta Lake

Microsoft Fabric

Power BI

Azure Functions

GitHub Copilot

Job description

XPT Software Australia Pty Ltd | Contract

Melbourne, Australia | Posted on 09/04/2026

• XPT SoftwareAustralia PTY Ltd, incorporated in 2016, is a Software Services company
• XPT works with topclients across Australia in Banking, Insurance, Telecom,Retail, Energy, Mining and Manufacturingdomains.
• We have 120+technocrats in Australia working at our clientlocations.
• XPT SoftwareAustralia is part of group companies which has globalpresence across India & Europe.
• We have served100+ clients globally, fulfilling their onsite-offshoreneeds.

Job Description

Role Overview

We are seeking a highlyexperienced Lead Data Engineer to drive the strategy, architecture,delivery, and optimization of enterprise-scale data platforms on MicrosoftAzure. The ideal candidate will combine deep technical expertise with strongleadership, stakeholder management, and delivery governance capabilities tobuild scalable, secure, and cost-efficient data solutions.

Must-Have Skills

• Strongexpertise in SQL, Python, and PySpark
• Extensiveexperience with Azure Data Factory (ADF) and Azure Synapse Analytics.
• Hands-onexperience with Delta Lake architecture and modern data lakehouseimplementations.
• Advancedknowledge of Data Modeling and Data Warehousing concepts.
• Strongexposure to the Microsoft Fabric ecosystem.
• Provenexpertise in designing cloud-native data architectures andenterprise-scale solutions.
• Strong design thinking and problem-solving capabilities.
• Workingknowledge of CI/CD pipelines and DevOps practices.
• Experiencein cloud cost optimization, performance tuning, and resource governance.

Key Responsibilities

• Leadand own the end-to-end delivery of enterprise data platforms,including architecture, development, deployment, and optimization.
• Defineand drive the data platform roadmap, ensuring alignment withbusiness objectives and strategic priorities.
• Architectand govern scalable data pipelines, data models, data warehouses, andlakehouse solutions using Azure services.
• Providetechnical leadership to Data Engineering teams through design reviews,code reviews, and implementation of engineering best practices.
• Drivethe adoption and implementation of Microsoft Fabric, APIs, AzureFunctions, and Python-based solutions.
• Ensureplatform scalability, reliability, security, and operational excellencewhile optimizing cloud costs.
• Establishand enforce data governance, data quality, security, and compliancestandards.
• Implementand drive CI/CD, DevOps, and Agile delivery practices across thedata engineering landscape.
• Collaboratewith business stakeholders, architects, and technology teams to translatebusiness requirements into scalable technical solutions.
• Mentor,coach, and develop Data Engineering talent, fostering a culture ofcontinuous learning and innovation.
• Leverage GitHub Copilot and AI-assisted engineering tools to improve productivityand solution quality.
• Driveinnovation by evaluating emerging technologies and identifyingopportunities for platform modernization.

Experience

• 10+years of overall IT experience, including 10+ years in Data Engineering.
• Minimum 5+ years of leadership experience managing large-scale DataEngineering programs and teams.
• Proventrack record of leading cross-functional teams and delivering complexenterprise data transformation initiatives.
• Experiencebuilding, hiring, and scaling high-performing Data Engineering teams.
• Experienceworking within multi-vendor and globally distributed deliveryenvironments.
• Strongexperience in stakeholder management, delivery governance, andexecutive-level communication.

Preferred Skills

• Experiencebuilding and managing enterprise APIs and Azure Function Apps.
• Experiencein solution architecture, stakeholder engagement, and deliverygovernance.
• Azurecertifications such as:
• AzureSolutions Architect Expert
• Familiaritywith MLOps, Data Science, and AI-driven analytics solutions.
• Hands-onexperience with Power BI and enterprise reporting platforms.
• Experienceleveraging AI and Generative AI capabilities within Data Engineeringecosystems.
• Strongownership mindset with a focus on accountability and business outcomes.
• Excellentcommunication, stakeholder management, and influencing skills.
• Abilityto balance technical leadership with delivery and people managementresponsibilities.
• Strategicthinker with a strong focus on execution excellence.
• Strongconflict resolution and cross-functional collaboration skills.
• Adaptabilityand resilience in fast-paced, evolving environments.
• Passionfor mentoring teams and fostering a culture of innovation and continuousimprovement.