Forward Deployed Engineer

Primus Connect; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

Primus Connect is seeking a Forward Deployed Engineer for Databricks to join a long-term enterprise data transformation programme. This hands-on role spans data engineering, data architecture and advanced data modelling, working directly with business stakeholders.

You will design and optimise Spark workloads, deliver Delta Live Tables pipelines, and implement governance with Unity Catalog across the global estate. Autonomy and adaptability are essential in this fast-moving environment.

Qualifications

• Strong experience in enterprise data modelling and architecture.
• Advanced SQL and Python / PySpark.
• Hands-on Databricks experience, including Delta Lake, Workflows and Unity Catalog
• Production experience with dbt and/or Spark Declarative Pipelines (SDP)
• Strong understanding of enterprise data architecture, including ingestion, integration, conformance and consumption layers
• Experience handling complex data challenges such as master/reference data, changing entities, conflicting definitions and data reconciliation
• Ability to translate complex business requirements into practical technical solutions
• Strong stakeholder management and communication skills
• Experience with data governance, access controls and security
• Terraform / Databricks Asset Bundles and CI/CD experience
• Comfortable working autonomously in an environment where priorities can change quickly

Responsibilities

• Design, optimise, and operate Apache Spark workloads across batch and streaming performance tuning, cost efficiency, production reliability
• Architect and deliver Delta Live Tables pipelines, Databricks Workflows, and Unity Catalog governance models across Customer's global estate
• Build and maintain infrastructure-as-code (Terraform, Terragrunt, Databricks Asset Bundles) with CI/CD automation via GitHub Actions
• Design data models, query optimisation strategies, and row-level security implementations in Lakebase
• Develop full-stack application components (Node.js backend, React frontend) for the NEXUS platform, including deployment via Databricks Apps
• Interoperate between Databricks and their on-prem and custom data platform
• You’ll be expected to take ownership of your workstream, work directly with stakeholders, define solutions and remain hands‑on throughout delivery.

Skills

Data modelling

Data architecture

Advanced SQL

Python / PySpark

Databricks experience

Delta Lake

Databricks Workflows

Unity Catalog

dbt

Spark

Terraform

CI/CD

Data governance

Stakeholder management

Tools

Databricks

Delta Lake

Unity Catalog

Databricks Workflows

dbt

Spark

Terraform

GitHub Actions

Terragrunt

Node.js

React

Job description

A Forward Deployed Engineer - Databricks is needed to join a long-term enterprise data transformation programme.

This is a hands-on role for someone who can operate across data engineering, data architecture and advanced data modelling, while working directly with business stakeholders.

Key experience needed for the Forward Deployed Engineer - Databricks:

• Strong experience in enterprise data modelling and architecture
• Advanced SQL and strong Python / PySpark
• Hands-on Databricks experience, including Delta Lake, Workflows and Unity Catalog
• Production experience with dbt and/or Spark Declarative Pipelines (SDP)
• Strong understanding of enterprise data architecture, including ingestion, integration, conformance and consumption layers
• Experience handling complex data challenges such as master/reference data, changing entities, conflicting definitions and data reconciliation
• Ability to translate complex business requirements into practical technical solutions
• Strong stakeholder management and communication skills
• Experience with data governance, access controls and security
• Terraform / Databricks Asset Bundles and CI/CD experience
• Comfortable working autonomously in an environment where priorities can change quickly

The day to day responsibilities for the Forward Deployed Engineer - Databricks, include:

• Design, optimise, and operate Apache Spark workloads across batch and streaming performance tuning, cost efficiency, production reliability
• Architect and deliver Delta Live Tables pipelines, Databricks Workflows, and Unity Catalog governance models across Customer's global estate
• Build and maintain infrastructure-as-code (Terraform, Terragrunt, Databricks Asset Bundles) with CI/CD automation via GitHub Actions
• Design data models, query optimisation strategies, and row-level security implementations in Lakebase
• Develop full-stack application components (Node.js backend, React frontend) for the NEXUS platform, including deployment via Databricks Apps
• Interoperate between Databricks and their on-prem and custom data platform

You’ll be expected to take ownership of your workstream, work directly with stakeholders, define solutions and remain hands‑on throughout delivery.