Senior Data Platform Engineer - Databricks (Hybrid London)

Oliver James; Greater London; Hybrid; GBP 96,000 - 111,000; Full time

Job summary

Oliver James in London is seeking a Senior Data Engineer to design, build and operate end-to-end data pipelines on Databricks within a hybrid London setup. You will lead data modelling initiatives and collaborate with analysts and engineers to structure data for analytics.

The role requires strong Python, SQL, and APIs experience, plus CI/CD and pipelines-as-code practices in an agile team. 12-month contract with a daily rate of £550 outside IR35.

Qualifications

• 5+ years' progressive data engineering experience.
• Strong Databricks and Spark expertise; platform internals, Delta Lake.
• Advanced Python with pipelines-as-code and CI/CD.
• Excellent data modelling skills and stakeholder communication.
• Experience querying data lakes/lakehouses and APIs ingestion.

Responsibilities

• Design, build, and operate end-to-end data pipelines.
• Lead data modelling with business analysts and engineers.
• Oversee full project lifecycle from planning to delivery.
• Maintain security and data protection throughout.

Skills

Databricks

Spark

Python

SQL

APIs

Agile delivery

Data modelling

Stakeholder communication

Tools

Databricks

Spark

dbt

PostgreSQL

Job description

Oliver James in London is seeking a Senior Data Engineer to design, build and operate end-to-end data pipelines on Databricks within a hybrid London setup. You will lead data modelling initiatives and collaborate with analysts and engineers to structure data for analytics.

The role requires strong Python, SQL, and APIs experience, plus CI/CD and pipelines-as-code practices in an agile team. 12-month contract with a daily rate of £550 outside IR35.