Remote Databricks Data Engineer — Data Pipelines Lead

Cyber Security training courses; Greater London; Hybrid; GBP 63,000 - 85,000; Full time

Benefits offered by this job

Remote work

Job summary

Unknown is seeking an experienced Databricks Data Engineer for a predominantly remote six-month contract in the UK, with occasional office visits in the South of England. The role focuses on delivering data provisioning for the Decision Science team, building and maintaining Databricks pipelines, and guiding engineering practices.

The candidate will collaborate with data scientists and business stakeholders, ensuring data quality and governance while supporting UAT and data delivery.

Qualifications

• Databricks, Python and SQL experience required.
• Experience in data engineering and ETL/ELT development.
• Experience with data validation and UAT support.

Responsibilities

• Delivering new data provisioning requests for the Decision Science team.
• Supporting and executing User Acceptance Testing (UAT) activities.
• Developing, maintaining and enhancing data pipelines within Databricks.
• Performing code reviews and promoting engineering best practices.
• Troubleshooting data-related issues and implementing improvements.
• Collaborating with data scientists, analysts and business stakeholders.
• Providing technical oversight and guidance to developers within the team.
• Ensuring data quality, performance and governance standards are maintained.

Skills

Databricks

Python

SQL

Data engineering

ETL/ELT development

Data validation

UAT support

Code review

Job description

Unknown is seeking an experienced Databricks Data Engineer for a predominantly remote six-month contract in the UK, with occasional office visits in the South of England. The role focuses on delivering data provisioning for the Decision Science team, building and maintaining Databricks pipelines, and guiding engineering practices.

The candidate will collaborate with data scientists and business stakeholders, ensuring data quality and governance while supporting UAT and data delivery.