Senior Data Engineer - Databricks Lakehouse (Azure)

Energy Jobline ZR; Surrey; Hybrid; CAD 101,000 - 168,000; Full time

Benefits offered by this job

Hybrid working model

Databricks investment in technology

Large-scale Lakehouse platform project

Professional development & training

Job summary

Energy Jobline ZR in Surrey is seeking a Senior Data Engineer with strong Databricks experience to join a hybrid team building a modern Lakehouse platform on Azure. You will design and implement scalable data pipelines, influence architecture and drive best practices across the data stack.

The role is hands-on, with opportunities to work on large-scale data, and to grow through training, certifications and technical exposure within a collaborative, engineering-driven environment.

Qualifications

• Commercial experience building solutions within Databricks.
• Strong hands-on PySpark, Spark SQL, and Delta Lake.
• Experience designing and supporting production-grade ETL/ELT pipelines.
• Strong Python and SQL development skills.
• Experience with large-scale distributed data processing environments.
• Understanding of Lakehouse architecture and modern data engineering best practices.
• Cloud experience within Azure, AWS or GCP.
• Excellent stakeholder management and communication skills.

Responsibilities

• Design, build and optimise Databricks-based solutions.
• Build scalable data pipelines using Databricks and PySpark.
• Develop high-performance batch and streaming data solutions.
• Design Delta Lake lakehouse architectures with medallion principles.
• Optimize Databricks workloads for performance and cost.
• Implement data quality, monitoring and observability frameworks.
• Support governance, security and access management.
• Collaborate with Data Scientists, Analysts and Product teams to deliver data products.
• Drive engineering excellence through code reviews and best practices.
• Identify opportunities to improve platform performance and reduce cloud costs.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

ETL/ELT pipelines

Python

SQL

Lakehouse architecture

Cloud platforms

Stakeholder management

Communication

Tools

Databricks

Delta Lake

Spark

Job description

Energy Jobline ZR in Surrey is seeking a Senior Data Engineer with strong Databricks experience to join a hybrid team building a modern Lakehouse platform on Azure. You will design and implement scalable data pipelines, influence architecture and drive best practices across the data stack.

The role is hands-on, with opportunities to work on large-scale data, and to grow through training, certifications and technical exposure within a collaborative, engineering-driven environment.