Senior Databricks Platform Engineer (Hybrid)

Gattaca; Greater London; Hybrid; GBP 72,000 - 88,000; Full time

Benefits offered by this job

Hybrid working

Annual leave

Birthday day off

Learning platforms

Private medical insurance

Mental health support

Home workspace assessment

Volunteer days

Lifestyle benefits

Job summary

Gattaca is seeking a Senior Platform Engineer to join its technology and data engineering team in a permanent hybrid role across Surrey and Greater London. You will help develop and optimise a Databricks data platform that supports analytics, machine learning and AI across the business.

You will design, build and maintain scalable data pipelines, contribute to platform architecture, and collaborate with Product, Analytics and Data Science teams to deliver reliable cloud data solutions.

Qualifications

• Significant experience building and supporting scalable, production‑grade data platforms.
• Strong hands‑on expertise with Databricks, Apache Spark, Delta Lake, Python and SQL.
• Good understanding of cloud‑based data engineering, ideally within Microsoft Azure environments.
• Experience with Infrastructure as Code tools such as Terraform, Bicep or similar.
• Understanding of data modelling, ETL and ELT processes, data quality, security and governance.
• Ability to collaborate effectively with technical and non‑technical stakeholders.
• Experience with Unity Catalog, MLflow or Databricks Asset Bundles would be advantageous.
• Knowledge of dbt, Kafka, Event Hubs or other data transformation and streaming technologies would be beneficial.

Responsibilities

• Design, build and enhance a secure, scalable and reliable Databricks platform.
• Develop and maintain batch and real‑time data pipelines using Databricks, Apache Spark and Delta Lake.
• Contribute to platform architecture, engineering standards and best practices across the data estate.
• Work with Product, Analytics and Data Science teams to deliver effective data platform solutions.
• Support platform operations, monitoring, performance optimisation and reliability.
• Apply Infrastructure as Code principles to support consistent and efficient platform management.
• Share technical knowledge and contribute to continuous improvement across the engineering team.

Skills

Databricks

Apache Spark

Delta Lake

Python

SQL

Terraform

Bicep

Unity Catalog

MLflow

Databricks Asset Bundles

dbt

Kafka

Event Hubs

Education

Degree in Computer Science/Data Engineering or related

Tools

Azure

Job description

Gattaca is seeking a Senior Platform Engineer to join its technology and data engineering team in a permanent hybrid role across Surrey and Greater London. You will help develop and optimise a Databricks data platform that supports analytics, machine learning and AI across the business.

You will design, build and maintain scalable data pipelines, contribute to platform architecture, and collaborate with Product, Analytics and Data Science teams to deliver reliable cloud data solutions.