Data Engineer

Talent; England; On-site; GBP 70,000 - 110,000; Full time

Job summary

Talent, a global brand undergoing a major greenfield Databricks implementation, invites a Data Engineer to build a Lakehouse from scratch. You’ll ingest data from SAP S/4 HANA, SAP ECC, Salesforce, and telemetry, creating batch and streaming pipelines with PySpark across bronze, silver, and gold layers.

You’ll work with a Tier 1 SI partner and Databricks specialists from day one, shaping governance with Unity Catalog and driving CI/CD and IaC. Staffordshire HQ on-site.

Qualifications

• Experience with Databricks platform and lakehouse architectures.
• Strong knowledge of PySpark, Spark SQL and data modeling.
• Familiarity with Unity Catalog governance and CI/CD practices.

Responsibilities

• Ingest data from SAP S/4 HANA, SAP ECC, Salesforce and telemetry sources.
• Build batch and streaming pipelines across bronze, silver and gold layers.
• Collaborate on governance, CI/CD and IaC initiatives.

Skills

Databricks

PySpark

Spark SQL

Unity Catalog

CI/CD

Infrastructure as Code

Tools

Delta Live Tables

Auto Loader

Job description

A rare chance to get in on the ground floor of a major greenfield Databricks implementation at one of the world's most recognised brands.

This is a transformational data journey and an opportunity for a Data Engineer to help build a Databricks Lakehouse platform from scratch. You won't be maintaining legacy pipelines, you'll be building something brand new and shaping the future of data at a global business.

What makes this stand out is who you'll be working alongside. A Tier 1 SI partner has been brought in to architect the platform, with Databricks themselves at the table ensuring everything is built to the highest standards from day one. The knowledge and exposure you'll gain is something most engineers simply don't get access to.

What You'll Be Doing

You'll be ingesting data from enterprise source systems including SAP S/4 HANA, SAP ECC, Salesforce, and telemetry data, building batch and streaming pipelines using PySpark, Spark SQL, Delta Live Tables, and Auto Loader across bronze, silver, and gold layers. You'll also model gold datasets for BI consumption in Tableau and Power BI, implement Unity Catalog governance, and collaborate on CI/CD and Infrastructure as Code.

It would be great if you have experience with some of the following:

• Strong hands-on Databricks experience
• PySpark, Spark SQL, and medallion architecture
• Unity Catalog and data governance
• Enterprise source system experience, SAP a strong advantage
• Comfortable in a greenfield environment
• Strong communicator who can knowledge share with a wider team

Why This Role?

• Greenfield build, own it from day one
• Work directly alongside a Tier 1 SI partner and Databricks specialists
• Continuous learning and best practice exposure throughout the project
• AI and ML ambitions on the horizon
• A globally recognised brand at an exciting point of transformation

The team work on-site at their global HQ in Staffordshire

If you want to work on something meaningful, learn from the very best, and leave a real mark on a world-class data platform, we'd love to hear from you.