Databricks Data & Analytics Engineer

J C Bamford Excavators Ltd; United Kingdom; Remote; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Onsite gym

In-house doctor

In-house dentist

ULEV car scheme

Cycle to Work Scheme

33 days holiday

Company pension

Job summary

JCB is seeking a Data & Analytics Engineer to own data pipelines and analytics datasets on the Databricks Lakehouse. You will transform raw data (bronze) into BI-ready gold models, ensure data quality, and enable fast, secure analytics with SQL warehouses and Unity Catalogues.

You will work with stakeholders and SI partners to gather requirements, optimize processes and deliver scalable data solutions that drive business value.

Qualifications

• Design and build batch/streaming data pipelines across bronze, silver, gold layers.
• Implement CDC patterns, incremental loads, partition tuning and data optimization.
• Develop tests, observability, and runbooks for data pipelines and models.

Responsibilities

• Design and implement batch/streaming pipelines (PySpark, Spark SQL, DLT, Auto Loader) across bronze, silver & gold layers.
• Implement CDC patterns, incremental loads, tune partitioning, Z Order, OPTIMIZE/VACUUM.
• Build robust tests (unit/integration), data expectations, and observability (alerts/metrics, runbooks).
• Collaborate on CI/CD with Platform teams (Repos, Git, deployment pipelines, Terraform)

Skills

PySpark

Spark SQL

DLT

Auto Loader

CDC patterns

Batch pipelines

Streaming pipelines

CI/CD

Terraform

Data governance

Databricks

Unity Catalog

Tableau

PowerBI

Stakeholder comms

Data modeling

Tools

Databricks

Unity Catalog

Tableau

PowerBI

Job description

JCB is seeking a Data & Analytics Engineer to own data pipelines and analytics datasets on the Databricks Lakehouse. You will transform raw data (bronze) into BI-ready gold models, ensure data quality, and enable fast, secure analytics with SQL warehouses and Unity Catalogues.

You will work with stakeholders and SI partners to gather requirements, optimize processes and deliver scalable data solutions that drive business value.