Data & Analytics Engineer — Databricks Pipelines & BI Models

JCB; Uttoxeter; On-site; GBP 31,000 - 69,000; Full time

Benefits offered by this job

33 days holiday

Company pension

Onsite gym

In-house doctor and dentist

ULEV car scheme

JCB Rewards Hub with discounts

Cycle to Work Scheme

Job summary

JCB is hiring a Data & Analytics Engineer to design, build, and optimise data pipelines on the Databricks Lakehouse. You will partner with stakeholders and SI partners to deliver scalable, governed datasets for fast, secure analytics using SQL warehouses and Unity Catalogues.

The role is a full-time permanent position based in the UK, focusing on modern data platforms, governance, and performance tuning to drive business value.

Qualifications

• Attention to detail and high personal standards for accuracy and consistency.
• Experienced in building client relationships and customer-focused.
• Strong stakeholder communication to translate business needs into data models.
• Documentation mindset: runbooks, catalog cards, readmes.
• Experience in a multinational business and complex system landscape.
• Flexible and positive agent for change.
• Team-oriented with collaborative mindset.

Responsibilities

• Design and implement batch and streaming pipelines across bronze, silver, and gold layers using PySpark, Spark SQL, DLT, and Auto Loader.
• Implement CDC patterns, incremental loads, and performance tuning via partitioning, Z Order, OPTIMIZE, VACUUM.
• Build robust tests, data expectations, and observability including alerts, metrics, and runbooks.
• Orchestrate workflows using Databricks Jobs.
• Collaborate on CI/CD with platform team using Repos, Git, deployment pipelines, and Terraform for jobs and IaC.
• Model curated gold datasets, dimensional models, and semantic layers for BI.
• Optimise SQL Warehouses for performance, concurrency and cost, with versioned metrics.
• Document tables with catalog cards covering owner, SLA, lineage, data contracts, and discoverability.
• Implement access controls with Unity Catalog.
• Adhere to naming conventions and tagging standards for owner, environment, cost centre, and classification.
• Participate in access reviews, audit remediation, privacy and compliance processes.
• Work with business stakeholders and SI partners to gather requirements and deliver scalable solutions.

Skills

Attention to detail

Customer focus

Stakeholder communication

Documentation mindset

Multinational experience

Change agent

Team collaboration

Tools

Databricks

Git

PySpark

SQL

Terraform

Unity

Tableau

Job description

JCB is hiring a Data & Analytics Engineer to design, build, and optimise data pipelines on the Databricks Lakehouse. You will partner with stakeholders and SI partners to deliver scalable, governed datasets for fast, secure analytics using SQL warehouses and Unity Catalogues.

The role is a full-time permanent position based in the UK, focusing on modern data platforms, governance, and performance tuning to drive business value.