Senior Databricks Data Engineer - Remote UK (12m Contract)

La Fosse; United States; Remote; GBP 100,000 - 131,000; Full time

Job summary

La Fosse is partnering with a global energy business to hire a Senior Data Engineer for a 12-month contract. You’ll lead the engineering behind a customer decisioning platform and take it from build through to stable production, working remotely within the UK.

You’ll own Databricks pipelines, optimize data flows, and collaborate with cross-functional teams to deliver reliable, scalable analytics. Strong SQL and Python/Spark skills, plus CI/CD with Git and Azure DevOps, are essential for success.

Qualifications

• 3+ years of data engineering experience with Databricks and big data pipelines.
• Strong SQL, Python/Spark and data pipeline engineering skills.
• Experience with CI/CD and production-grade data platforms.

Responsibilities

• Own pipeline architecture, orchestration and production readiness on Databricks.
• Build and review eligibility, consent, suppression, contact-policy and cooldown logic.
• Own activation datasets, file manifests, delivery status and SFTP integrations.
• Review and sequence PRs, enforce end-to-end validation and production quality.
• Lead production cutover, rerun and recovery, observability and incident response.

Skills

Advanced SQL

Python/Spark

Databricks

CI/CD

Tools

Git

Azure DevOps

Job description

La Fosse is partnering with a global energy business to hire a Senior Data Engineer for a 12-month contract. You’ll lead the engineering behind a customer decisioning platform and take it from build through to stable production, working remotely within the UK.

You’ll own Databricks pipelines, optimize data flows, and collaborate with cross-functional teams to deliver reliable, scalable analytics. Strong SQL and Python/Spark skills, plus CI/CD with Git and Azure DevOps, are essential for success.