Hybrid Data Engineer: Azure Databricks & Delta Lake

Sse Enterprise; Perth; On-site; GBP 36,000 - 54,000; Full time

Benefits offered by this job

Private healthcare discounts

Cycle to Work

Family entitlements

Job summary

SSE Enterprise is seeking a Data Engineer to design, build and optimise data ingestion, transformation and serving layers across Azure Databricks, Delta Lake and Databricks SQL. You will enable reliable data products and insights for stakeholders, collaborating with data architects, analysts and product teams to deliver robust ELT/ETL pipelines.

In the Data & AI team, you will contribute to our Renewables Data Platform on Databricks and migrate existing data solutions from Synapse.

Qualifications

• Experience delivering data solutions in a growing business environment with varied data needs.
• Strong communication skills with stakeholders across teams.
• Proven data engineering experience using Azure Databricks and Delta Lake patterns.
• Technical capability in Python, PySpark and SQL for transformations and data quality.

Responsibilities

• Build and maintain metadata-driven pipelines using Azure Databricks, ensuring data quality.
• Develop Delta Lake layers following bronze/silver/gold patterns and BI data models.
• Use Databricks tooling to perform large-scale transformations and monitor performance.
• Support governance, security, and data contracts with Unity Catalog lineage and permissions.
• Collaborate with DevOps and product teams to deliver CI/CD driven solutions.

Skills

Azure Databricks

Delta Lake

Databricks SQL

Python

PySpark

SQL

Power BI

CI/CD

Data Modeling

Unity Catalog

Tools

Azure Databricks

Databricks SQL

Job description

SSE Enterprise is seeking a Data Engineer to design, build and optimise data ingestion, transformation and serving layers across Azure Databricks, Delta Lake and Databricks SQL. You will enable reliable data products and insights for stakeholders, collaborating with data architects, analysts and product teams to deliver robust ELT/ETL pipelines.

In the Data & AI team, you will contribute to our Renewables Data Platform on Databricks and migrate existing data solutions from Synapse.