Salary: £31,000 - 69,000 per year
Requirements:
- Great attention to detail and excellent personal standards relating to accuracy and consistency.
- Customer focused and able to build client relationships.
- Strong stakeholder communication skills, with the ability to translate business needs into value-adding data models and pipelines.
- A documentation mindset, including runbooks, catalog cards, and readmes.
- Experience of a multinational business and system landscape.
- Flexible and able to act as a positive agent for change.
- Enjoys working as part of a team.
Responsibilities:
- Design and implement batch and streaming pipelines across bronze, silver, and gold layers using PySpark, Spark SQL, DLT, and Auto Loader.
- Implement CDC patterns, incremental loads, and performance tuning through partitioning, Z Order, OPTIMIZE, and VACUUM.
- Build robust tests, data expectations, and observability including alerts, metrics, and runbooks.
- Orchestrate workflows using Databricks Jobs.
- Collaborate on CI/CD with the platform team using Repos, Git, deployment pipelines, and Terraform for jobs and infrastructure as code.
- Model curated gold datasets, dimensional models, and semantic layers for BI.
- Optimise SQL Warehouses for performance, concurrency, and cost, while maintaining versioned metric definitions.
- Document tables with catalog cards covering owner, SLA, lineage, and data contracts, and support discoverability.
- Implement access controls with Unity Catalog.
- Adhere to naming conventions and tagging standards for owner, environment, cost centre, and classification.
- Participate in access reviews, audit remediation, and privacy and compliance processes.
- Work closely with key business stakeholders and SI partners to gather requirements, optimise business processes, and deliver scalable solutions that drive business value.
Technologies:
- CI/CD
- Databricks
- Git
- Support
- PySpark
- SQL
- Spark
- Terraform
- Unity
- GameDev
- Security
- Tableau
More:
We are JCB, hiring a full-time permanent Data & Analytics Engineer during an exciting transformation of our global data capabilities. You will join a team focused on designing, building, and optimising reliable data pipelines and well-governed analytical datasets on the Databricks Lakehouse, enabling fast and secure analytics through SQL warehouses and Unity Catalogues.
Benefits:
- We offer a competitive salary
- 33 days holiday
- company pension
- onsite gym
- in-house doctor and dentist
- an ULEV car scheme
- access to our JCB Rewards Hub with high street discounts
- our Cycle to Work Scheme
We are committed to diversity, fairness, and an inclusive recruitment process.