Platform Engineer

Gattaca; East Horsley; Hybrid; GBP 80,000 - 90,000; Full time

Benefits offered by this job

Hybrid working

25 days leave

Birthday day off

Flexible hours

Learning access

Private medical

Home workspace

Volunteer days

Lifestyle benefits

Job summary

Gattaca is seeking a Senior Platform Engineer to join its technology and data engineering team in a permanent hybrid role across Surrey and Greater London. You will design, build and optimise a Databricks data platform to support analytics, ML, and AI across the business.

You will develop batch and real-time data pipelines using Databricks, Spark and Delta Lake, contribute to platform architecture, and apply IaC to ensure reliability and scalability.

Qualifications

• Significant experience building and supporting scalable, production-grade data platforms.
• Strong hands-on expertise with Databricks, Apache Spark, Delta Lake, Python and SQL.
• Good understanding of cloud-based data engineering, ideally within Microsoft Azure environments.
• Experience with Infrastructure as Code tools such as Terraform, Bicep or similar.
• Understanding of data modelling, ETL and ELT processes, data quality, security and governance.
• Ability to collaborate effectively with technical and non-technical stakeholders.
• Experience with Unity Catalog, MLflow or Databricks Asset Bundles would be advantageous.
• Knowledge of dbt, Kafka, Event Hubs or other data transformation and streaming technologies would be beneficial.

Responsibilities

• Design, build and enhance a secure, scalable and reliable Databricks platform.
• Develop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta Lake.
• Contribute to platform architecture, engineering standards and best practices across the data estate.
• Work with Product, Analytics and Data Science teams to deliver effective data platform solutions.
• Support platform operations, monitoring, performance optimisation and reliability.
• Apply Infrastructure as Code principles to support consistent and efficient platform management.
• Share technical knowledge and contribute to continuous improvement across the engineering team.

Skills

Databricks

Apache Spark

Delta Lake

Python

SQL

Azure

Data modelling

ETL/ELT

Security & governance

Stakeholder communication

MLflow

Unity Catalog

dbt

Kafka

Education

Bachelor's degree or equivalent in a related field

Tools

Terraform

Bicep

Databricks Asset Bundles

Kafka

Event Hubs

dbt

Job description

Our client is seeking a Senior Platform Engineer to join its technology and data engineering team in a permanent hybrid role across Surrey and Greater London. This is a hands-on opportunity to help develop and optimise a Databricks data platform that supports analytics, machine learning and artificial intelligence across the business.

Key Responsibilities:

• Design, build and enhance a secure, scalable and reliable Databricks platform
• Develop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta Lake
• Contribute to platform architecture, engineering standards and best practices across the data estate
• Work with Product, Analytics and Data Science teams to deliver effective data platform solutions
• Support platform operations, monitoring, performance optimisation and reliability
• Apply Infrastructure as Code principles to support consistent and efficient platform management
• Share technical knowledge and contribute to continuous improvement across the engineering team

Job Requirements:

• Significant experience building and supporting scalable, production-grade data platforms
• Strong hands-on expertise with Databricks, Apache Spark, Delta Lake, Python and SQL
• Good understanding of cloud-based data engineering, ideally within Microsoft Azure environments
• Experience with Infrastructure as Code tools such as Terraform, Bicep or similar
• Understanding of data modelling, ETL and ELT processes, data quality, security and governance
• Ability to collaborate effectively with technical and non-technical stakeholders
• Experience with Unity Catalog, MLflow or Databricks Asset Bundles would be advantageous
• Knowledge of dbt, Kafka, Event Hubs or other data transformation and streaming technologies would be beneficial

Desirable Experience:

• Databricks certifications
• Experience working with retail or consumer packaged goods data, including point-of-sale, inventory or supply chain datasets
• Understanding of modern data platform architecture and cloud engineering practices
• A degree in Computer Science, Data Engineering or a related discipline, or equivalent practical experience

Benefits:

• Hybrid working, typically with two days in the office, alongside a work-from-anywhere policy
• 25 days Annual leave allowance, bank holidays and an additional day off for a birthday
• Summer working hours and flexible working arrangements
• Access to learning platforms, professional development courses and structured career progression
• Private medical insurance, healthcare support and mental health services
• Home workspace assessment to support a safe and productive working environment
• Paid volunteering days and opportunities to support charitable causes
• Access to car purchase, gym, technology and other lifestyle benefits

If you are an experienced Platform Engineer with strong Databricks and data platform engineering expertise, this is an excellent opportunity to contribute to modern cloud data solutions at scale.

Salary is negotiable but in the region of £80,000 plus bonus and other benefits