Databricks Forward-Deployed Engineer: Data Architect

Primus Connect; Greater London; Presencial; GBP 90 000 - 130 000; Tempo integral

Resumo da oferta

Primus Connect is seeking a Forward Deployed Engineer for Databricks to join a long-term enterprise data transformation programme. This hands-on role spans data engineering, data architecture and advanced data modelling, working directly with business stakeholders.

You will design and optimise Spark workloads, deliver Delta Live Tables pipelines, and implement governance with Unity Catalog across the global estate. Autonomy and adaptability are essential in this fast-moving environment.

Qualificações

• Strong experience in enterprise data modelling and architecture.
• Advanced SQL and Python / PySpark.
• Hands-on Databricks experience, including Delta Lake, Workflows and Unity Catalog
• Production experience with dbt and/or Spark Declarative Pipelines (SDP)
• Strong understanding of enterprise data architecture, including ingestion, integration, conformance and consumption layers
• Experience handling complex data challenges such as master/reference data, changing entities, conflicting definitions and data reconciliation
• Ability to translate complex business requirements into practical technical solutions
• Strong stakeholder management and communication skills
• Experience with data governance, access controls and security
• Terraform / Databricks Asset Bundles and CI/CD experience
• Comfortable working autonomously in an environment where priorities can change quickly

Responsabilidades

• Design, optimise, and operate Apache Spark workloads across batch and streaming performance tuning, cost efficiency, production reliability
• Architect and deliver Delta Live Tables pipelines, Databricks Workflows, and Unity Catalog governance models across Customer's global estate
• Build and maintain infrastructure-as-code (Terraform, Terragrunt, Databricks Asset Bundles) with CI/CD automation via GitHub Actions
• Design data models, query optimisation strategies, and row-level security implementations in Lakebase
• Develop full-stack application components (Node.js backend, React frontend) for the NEXUS platform, including deployment via Databricks Apps
• Interoperate between Databricks and their on-prem and custom data platform
• You’ll be expected to take ownership of your workstream, work directly with stakeholders, define solutions and remain hands‑on throughout delivery.

Conhecimentos

Data modelling

Data architecture

Advanced SQL

Python / PySpark

Databricks experience

Delta Lake

Databricks Workflows

Unity Catalog

dbt

Spark

Terraform

CI/CD

Data governance

Stakeholder management

Ferramentas

Databricks

Delta Lake

Unity Catalog

Databricks Workflows

dbt

Spark

Terraform

GitHub Actions

Terragrunt

Node.js

React

Descrição da oferta de emprego

Primus Connect is seeking a Forward Deployed Engineer for Databricks to join a long-term enterprise data transformation programme. This hands-on role spans data engineering, data architecture and advanced data modelling, working directly with business stakeholders.

You will design and optimise Spark workloads, deliver Delta Live Tables pipelines, and implement governance with Unity Catalog across the global estate. Autonomy and adaptability are essential in this fast-moving environment.