Senior Data Engineer: Azure & Databricks Architecture Lead

NEC Australia Pty Ltd; Melbourne; Vor Ort; AUD 140.000 - 190.000; Vollzeit

Zusammenfassung

NEC Australia Pty Ltd is seeking a Senior Data Engineer to lead design, build, and operation of scalable data platforms on Azure and Databricks. You will craft data pipelines with Spark, SQL, and Python, delivering trusted datasets for reporting and analytics.

You will also implement CI/CD, governance, and data quality frameworks while mentoring engineers and collaborating with stakeholders on scalable business solutions.

Qualifikationen

• Extensive experience in Data Engineering or Data Platform Engineering.
• Strong hands-on expertise with Databricks.
• Experience building cloud data solutions within Microsoft Azure.
• Strong SQL and data modelling skills.
• Experience with CI/CD, DevOps, and automated deployments.
• Knowledge of data governance, security, monitoring, and observability.
• Excellent stakeholder engagement and problem-solving skills.
• Delta Lake, Unity Catalog.
• Power BI integration.
• Azure and/or Databricks certifications.
• Consulting or professional services experience.

Aufgaben

• Design and develop enterprise data platforms using Azure and Databricks.
• Build scalable data pipelines using Spark, SQL, and Python.
• Deliver trusted datasets for reporting, analytics, and BI.
• Implement CI/CD, automation, governance, and data quality frameworks.
• Optimise platform performance, reliability, and cost efficiency.
• Provide technical leadership and mentor engineering teams.
• Collaborate with stakeholders to deliver scalable business solutions.

Kenntnisse

Databricks

Azure

SQL

Python

CI/CD

DevOps

Data governance

Delta Lake

Unity Catalog

Stakeholder engagement

Tools

Power BI

Azure Databricks

CI/CD tooling

Monitoring/Observability

Security governance

Jobbeschreibung

NEC Australia Pty Ltd is seeking a Senior Data Engineer to lead design, build, and operation of scalable data platforms on Azure and Databricks. You will craft data pipelines with Spark, SQL, and Python, delivering trusted datasets for reporting and analytics.

You will also implement CI/CD, governance, and data quality frameworks while mentoring engineers and collaborating with stakeholders on scalable business solutions.