Data & Analytics Engineer: Databricks Lakehouse Pipelines

JCB; Rocester; On-site; GBP 65,000 - 105,000; Full time

Benefits offered by this job

33 days holiday

Company pension

Onsite gym

In-house doctor

In-house dentist

ULEV car scheme

Rewards Hub discounts

Cycle to Work

Job summary

JCB, based in the United Kingdom, is seeking a Data & Analytics Engineer to design, build and optimise data pipelines on the Databricks Lakehouse. You will transform raw data into gold datasets, ensure data quality, and enable fast secure analytics for stakeholders.

You will work with PySpark, Spark SQL, DLT, and Auto Loader, implement CDC patterns, orchestrate Databricks Jobs, and collaborate on CI/CD with Platform teams. Strong communication and governance are essential.

Qualifications

• Experience designing batch/streaming data pipelines on Databricks.

Responsibilities

• Design and implement batch/streaming pipelines across bronze, silver & gold layers.

Skills

PySpark

Spark SQL

DLT

Auto Loader

Databricks

SQL

Tableau

PowerBI

CI/CD

Terraform

Unity Catalog

Data Testing

Tools

Git

Repos

Terraform

Job description

JCB, based in the United Kingdom, is seeking a Data & Analytics Engineer to design, build and optimise data pipelines on the Databricks Lakehouse. You will transform raw data into gold datasets, ensure data quality, and enable fast secure analytics for stakeholders.

You will work with PySpark, Spark SQL, DLT, and Auto Loader, implement CDC patterns, orchestrate Databricks Jobs, and collaborate on CI/CD with Platform teams. Strong communication and governance are essential.