Lead Data Engineer — Build AI-Driven Data Platforms

Endava; New South Wales; Hybrid; AUD 150.000 - 210.000; Vollzeit

Benefits dieser Stelle

Monthly Lifestyle Allowance

Novated Leasing

Loyalty Leave

Inclusive Parental Leave

Work From Anywhere

Hybrid working

Zusammenfassung

Endava is expanding its Australian Data & AI capability and is seeking a Lead Data Engineer to help design, build and operate reliable data platforms that transform complex data into actionable insights.

You’ll work across the data lifecycle with Python and SQL, and hands‑on experience with Databricks, Snowflake or Microsoft Fabric. Collaboration with analysts, data scientists and engineers will be key to delivering secure, scalable data solutions.

Qualifikationen

• Hands-on experience delivering production data solutions with Databricks, Snowflake or Microsoft Fabric.
• Strong Python and SQL programming skills.
• Experience designing and operating data pipelines with ETL/ELT, orchestration and monitoring.

Aufgaben

• Design, build and maintain data pipelines to ingest, transform and deliver data from a range of sources, including APIs.
• Develop solutions using Databricks, Snowflake or Microsoft Fabric, selecting approaches that suit the client’s requirements and existing environment.
• Contribute to data architecture and solution design, including data storage, integration and modelling.
• Develop data models, ontologies and semantic layers that establish consistent business definitions and support analytics and reporting.
• Implement pipeline orchestration, scheduling, monitoring and operational support to keep data services reliable.
• Troubleshoot data and pipeline issues, improving performance, scalability and cost efficiency.
• Apply data quality controls, automated testing and validation throughout the data lifecycle.
• Implement role-based access control and follow security best practices for data platforms and integrations.
• Apply DevOps practices to data engineering, including version control, repository management, CI/CD and automated deployment.
• Build data visualisations and reports that make information clear and useful to business users.
• Document solutions, review code and share knowledge to support maintainable delivery and continuous improvement.

Kenntnisse

Python

SQL

Data pipelines

RBAC / security

Git / CI/CD

Communication

Stakeholder collaboration

Ausbildung

Bachelor's degree in a relevant field

Tools

Databricks

Snowflake

Microsoft Fabric

Jobbeschreibung

Endava is expanding its Australian Data & AI capability and is seeking a Lead Data Engineer to help design, build and operate reliable data platforms that transform complex data into actionable insights.

You’ll work across the data lifecycle with Python and SQL, and hands‑on experience with Databricks, Snowflake or Microsoft Fabric. Collaboration with analysts, data scientists and engineers will be key to delivering secure, scalable data solutions.