Data Engineer

UK Tote Group

Greater Manchester

On-site

GBP 65,000 - 90,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive Basic Salary
Discretionary Bonus Scheme
Company Shares Option Plan
Contributory pension scheme
Life insurance (4 x basic salary)
Simply Health Cash Plan
Holiday entitlement (33 days incl. BH)
Study Support and progression
24/7 employee assistance helpline
Agile office environment with free par
Regular social and volunteering events

Job summary

UK Tote Group is seeking an experienced Data Engineer to design, build and optimise a Databricks-based Lakehouse enabling real-time data, analytics and reporting across the Tote. You will work onsite at the Wigan Office at least one day per week, collaborating with engineering and BI teams to deliver scalable, secure data pipelines on AWS using Spark, Kafka and Delta Lake.

Join a fast-paced, collaborative team and contribute to the Medallion architecture, data ingestion from S3, and the shaping

Qualifications

  • Experience building pipelines in Databricks with Spark (PySpark) and Structured Streaming.
  • Strong knowledge of Delta Lake, DLT, and Medallion Architecture.
  • Solid AWS experience, especially S3, plus monitoring tools.
  • Proficient in Python and SQL for data engineering and analytics.

Responsibilities

  • Design, build, and optimise streaming and batch pipelines in Databricks.
  • Develop bronze, silver, and gold delta tables for downstream analytics and APIs.
  • Ingest data from AWS MSK (Kafka), S3, and external APIs into the Lakehouse.
  • Collaborate with reporting engineers to enable high-performance dashboards.
  • Monitor and tune pipeline performance using Databricks metrics and CloudWatch.

Skills

Python
SQL
CI/CD pipelines
Analytical thinking
Strong communication

Tools

Databricks
Apache Spark
Kafka (MSK)
Delta Lake
Declarative Pipelines (DLT)
Medallion Architecture
AWS (S3)
CloudWatch
Databricks SQL Warehouses
GitHub Actions
Azure DevOps

Job description

Are you an experienced Data Engineer who is a self-starter by nature, takes ownership of your work and enjoys designing end-to-end solutions that deliver measurable value? UK Tote Group are looking for Data Engineers to join the team where you’ll play a key role in designing, building, and optimising the Databricks-based Lakehouse that drives real-time data, analytics, and reporting across the Tote.

Our technology powers real-time insights, supports safer gambling, and helps us deliver trusted, customer-first products across the UK and international markets. Data sits at the heart of how we understand our customers and partners, optimise commercial performance and enhance operational processes so this is an essential role in driving business growth and commercial success.

Reporting into the Data Discipline Lead you will build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Lakeflow Spark Declarative Pipelines (formerly DLT), and Kafka (MSK), ensuring our business teams have fast, trusted data at their fingertips. This is a hands-on engineering role where you’ll collaborate across engineering and BI, to deliver scalable, secure, and governed data solutions under Unity Catalog.

Our BI and Data teams are based in our Wigan Office, where you will be expected to work onsite a minimum of 1 day per week with core business hours Monday to Friday 9am to 5pm. This role will also form part of our on-call rota, which will be discussed in further detail at interview.

What You’ll Be Doing
  • Designing, building, and optimising streaming and batch pipelines in Databricks
  • Develop robust bronze, silver, and gold delta tables using the Medallion Architecture to serve downstream analytics and APIs
  • Implement and manage integrations from AWS MSK (Kafka), S3, and external APIs into the Lakehouse
  • Collaborate with reporting engineers to enable high-performance dashboards through Databricks SQL Warehouses
  • Monitor, tune, and troubleshoot pipeline performance using Databricks metrics, CloudWatch, and AWS Cost Explorer
What We Are Looking For

We’re looking for experienced Data Engineers with proven expertise in building pipelines in Databricks and a strong grasp of Apache Spark, whether in PySpark, including Structured Streaming.

You should have experience with Kafka (MSK) and real-time data ingestion, as well as a deep understanding of Delta Lake, Declarative Pipelines (DLT) and the Medallion Architecture. A strong AWS background is important, particularly with services such as S3.

You’ll need to be proficient in Python and SQL for data engineering and analytics, and comfortable implementing CI/CD pipelines using tools such as GitHub Actions, Azure DevOps. Solid experience with Git, version control, and Spark performance tuning will help you succeed in this role.

Most importantly, you’ll bring a collaborative, proactive attitude and an ability to balance platform reliability with the pace of delivery. We are looking for engineers who are analytical, detail-oriented, and motivated by solving complex data challenges. Great communication skills are also essential with the ability to explain data concepts clearly to both technical and non-technical colleagues.

Why Join Us?

In return, you'll have the opportunity to work with a modern cloud-based technology stack, tackle complex real-time data challenges, and play a key role in shaping the future of data at Tote. You'll have the autonomy to shape solutions, influence technical direction and solve complex engineering challenges at scale, while working alongside experienced technology and data professionals in a collaborative, agile environment.

Additionally, our company benefits package includes;

  • Competitive Basic Salary
  • Discretionary Bonus Scheme
  • Company Shares Option Plan
  • Contributory pension scheme
  • Life insurance (4 x basic salary)
  • Simply Health Cash Plan
  • Holiday entitlement (33 days inclusive of bank holidays)
  • Study Support and opportunity for progression and development
  • Confidential 24/7 365 employee assistance helpline
  • Agile and collaborative office environment with free parking, fruit, biscuits, and drinks
  • Regular social events, charity events and volunteering opportunities
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

UK Tote Group • Wigan

On-site
GBP 70,000 - 90,000
Competitive Basic Salary
Discretionary Bonus Scheme
Company Shares Option Plan
+5
Data Engineer
Data Engineer

Searchability® • Greater Manchester

Hybrid
GBP 54,000 - 66,000
Discretionary bonus
Share option plan
Pension scheme
+6
Real-Time Data Engineer - Databricks Lakehouse Expert
Real-Time Data Engineer - Databricks Lakehouse Expert

UK Tote Group • Greater Manchester

On-site
GBP 65,000 - 90,000
Competitive Basic Salary
Discretionary Bonus Scheme
Company Shares Option Plan
+8
Data Engineer (early career)
Data Engineer (early career)

Optima Partners • City of Edinburgh

On-site
GBP 42,000 - 54,000
Competitive salary
Annual bonus 15%
37 days holiday
+5
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

hireful • Greater London

Remote
GBP 77,000 - 94,000
Health insurance
Private pension scheme
Life assurance
+2
Data Engineer
Data Engineer

Gravitas Recruitment Group • Manchester

Hybrid
GBP 50,000 - 70,000
Discretionary bonus
Hybrid working
Training & certifications
+3
Lead Data Engineer
Lead Data Engineer

Betfred Group Holdings Limited • Manchester

Hybrid
GBP 85,000 - 105,000
Pension
Discretionary bonus
Generous annual leave
+5
Data Engineer
Data Engineer

Gravitas Recruitment Group UK • Manchester

Hybrid
GBP 48,000 - 55,000
Discretionary bonus
Hybrid working
Training & certifications
+1
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

Hireful • City Of London

Remote
GBP 77,000 - 94,000
Health insurance
Bonus 10%
Lead Databricks Engineer
Lead Databricks Engineer

EPAM Systems Inc • City of Westminster

Hybrid
GBP 120,000 - 150,000
ESPP
Private medical insurance
Dental care
+4