Lead Data Engineer — Azure/Databricks for Government

Ingrity Pty; Canberra; Hybrid; AUD 180,000 - 260,000; Full time

Job summary

INGRITY is seeking a Lead Data Engineer to lead design, build, and testing of data ingestion, transformation and visualization solutions across Azure and Databricks. You will prepare data to support decision-making for a federal government department and drive quality, performance and scalability.

You will lead delivery efforts within an established agile team, collaborating with project teams and providing technical leadership and quality oversight.

Qualifications

• 5+ years data engineering experience with relevant qualifications or training.
• Experience delivering large/complex data movement, transformation and visualization in cloud environments.
• Hands-on Azure data tooling and data processing stack experience required.

Responsibilities

• Design, build, test and maintain data ingestion and transformation solutions for current and emerging needs.
• Develop reusable, automated ingestion and transformation patterns and frameworks.
• Prepare data for analytics, visualization and AI use cases with focus on quality and performance.
• Support other data engineers with quality reviews and feedback.
• Collaborate with project teams to deliver outcomes aligned with departmental priorities.
• Participate in agile delivery and attend quarterly ceremonies and key team events.

Skills

Data engineering

ETL/ELT

Azure expertise

Performance tuning

Automated ingestion

Analytics-ready data

Power BI

Communication

Tools

Azure Data Factory

SQL Server Integration Services

Databricks

SQL Server

Azure Data Lake Storage

Azure Machine Learning

Azure DevOps

Visual Studio

Job description

INGRITY is seeking a Lead Data Engineer to lead design, build, and testing of data ingestion, transformation and visualization solutions across Azure and Databricks. You will prepare data to support decision-making for a federal government department and drive quality, performance and scalability.

You will lead delivery efforts within an established agile team, collaborating with project teams and providing technical leadership and quality oversight.