Senior Data Engineer Lead — Hybrid, Global Impact

Australian Department Of Industry, Science And Resources; Sydney; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Flexible hybrid working

Global career pathways

Continuous learning

Well-being & lifestyle allowance

Loyalty leave

Work From Anywhere days

Job summary

Endava is seeking a Lead Data Engineer to design, build and operate reliable data platforms that turn complex data into actionable insights for clients. You’ll work across the data lifecycle, using Python and SQL, with hands-on experience in Databricks, Snowflake or Microsoft Fabric.

You’ll collaborate with clients, analysts and engineers to translate requirements into secure, scalable data solutions, while guiding engineering practices and contributing to design decisions.

Qualifications

• Hands-on experience delivering production data solutions using Databricks, Snowflake or Microsoft Fabric.
• Strong programming skills in Python and SQL.
• Experience designing, developing and operating data pipelines with orchestration and monitoring.
• A sound understanding of data architecture and modelling techniques.
• Experience integrating data via APIs and ensuring security best practices.

Responsibilities

• Translate business requirements into technical data solutions in collaboration with clients.
• Design, build and maintain data pipelines from multiple sources, including APIs.
• Develop data models and semantic layers to support analytics and reporting.
• Implement pipeline orchestration, scheduling, monitoring and operational support.
• Apply DevOps practices: version control, CI/CD and automated deployment for data solutions.
• Build data visualisations and reports for business users.
• Ensure data quality controls and automated testing throughout the lifecycle.
• Adhere to RBAC and data security best practices.

Skills

Databricks

Snowflake

Microsoft Fabric

Python

SQL

Data pipelines

RBAC

Git

CI/CD

Data modelling

Tools

Git

CI/CD

Job description

Endava is seeking a Lead Data Engineer to design, build and operate reliable data platforms that turn complex data into actionable insights for clients. You’ll work across the data lifecycle, using Python and SQL, with hands-on experience in Databricks, Snowflake or Microsoft Fabric.

You’ll collaborate with clients, analysts and engineers to translate requirements into secure, scalable data solutions, while guiding engineering practices and contributing to design decisions.