Senior Data Engineer

La Fosse; United States; Remote; GBP 100,000 - 131,000; Full time

Job summary

La Fosse is partnering with a global energy business to hire a Senior Data Engineer for a 12-month contract. You’ll lead the engineering behind a customer decisioning platform and take it from build through to stable production, working remotely within the UK.

You’ll own Databricks pipelines, optimize data flows, and collaborate with cross-functional teams to deliver reliable, scalable analytics. Strong SQL and Python/Spark skills, plus CI/CD with Git and Azure DevOps, are essential for success.

Qualifications

• 3+ years of data engineering experience with Databricks and big data pipelines.
• Strong SQL, Python/Spark and data pipeline engineering skills.
• Experience with CI/CD and production-grade data platforms.

Responsibilities

• Own pipeline architecture, orchestration and production readiness on Databricks.
• Build and review eligibility, consent, suppression, contact-policy and cooldown logic.
• Own activation datasets, file manifests, delivery status and SFTP integrations.
• Review and sequence PRs, enforce end-to-end validation and production quality.
• Lead production cutover, rerun and recovery, observability and incident response.

Skills

Advanced SQL

Python/Spark

Databricks

CI/CD

Tools

Git

Azure DevOps

Job description

Senior Data Engineer | Databricks | 12-Month Contract | Remote (UK) | Up to £625/day Inside IR35

La Fosse is partnering with a global energy business to hire a Senior Data Engineer for a 12-month contract. You’ll lead the engineering behind a customer decisioning platform and take it from build through to stable production.

What you’ll do

• Own pipeline architecture, orchestration and production readiness on Databricks
• Build and review eligibility, consent, suppression, contact-policy and cooldown logic
• Own the activation datasets, file manifests, delivery status and SFTP integrations
• Review and sequence PRs, and enforce end-to-end, regression and production validation
• Lead production cutover, rerun and recovery, observability, alerting and incident response

What you’ll bring

• Advanced SQL, Python/Spark and hands-on Databricks engineering
• Workflow orchestration, dependency management, idempotency and scheduled or triggered jobs
• CI/CD with Git and Azure DevOps, PR review, unit and integration testing, and environment promotion
• Production support, data quality controls, reconciliation and incident diagnosis

Nice to have

• CRM decisioning, customer eligibility, consent or activation experience
• Comarch, Salesforce Marketing Cloud (SFMC) or SFTP interface experience