Databricks Platform Engineer: Data Platform & Automation Lead

Fltalent; Sefton; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

Fltalent is recruiting a Cloud Data Platform Engineer to own and operate the data platform supporting data engineering, analytics and ML teams. You will make the platform dependable, secure and efficient, combining hands-on engineering with operational ownership to reduce infra and access barriers.

You will work with engineering and analytics colleagues to enhance platform capabilities, enforce controls, and improve deployment, monitoring and maintenance processes.

Qualifications

• Experience managing Databricks in production environments.
• Strong understanding of Spark, Delta Lake and Unity Catalog.
• Experience with one or more major cloud providers (storage/networking/identity).
• Proficiency with Terraform and Git-based deployment pipelines.
• Good Python and SQL skills; PySpark for automation.

Responsibilities

• Platform engineering and automation of data workloads and deployments.
• Manage compute resources for data processing, analytics and modelling.
• Establish automated release processes with test and deployment pipelines.
• Maintain configurations and engineering standards for workloads.
• Support scheduling and integrations with the data ecosystem.
• Provide platform foundations for data science experimentation and production modelling.

Skills

Databricks management

Apache Spark

Unity Catalog

Python

SQL

PySpark

Automation scripting

Tools

Terraform

Git

Job description

Fltalent is recruiting a Cloud Data Platform Engineer to own and operate the data platform supporting data engineering, analytics and ML teams. You will make the platform dependable, secure and efficient, combining hands-on engineering with operational ownership to reduce infra and access barriers.

You will work with engineering and analytics colleagues to enhance platform capabilities, enforce controls, and improve deployment, monitoring and maintenance processes.