Senior Data Engineer

Primus Connect; Greater London; Remote; GBP 81,000 - 106,000; Full time

Job summary

Primus Connect seeks a French-speaking Senior Data Engineer to design and implement a Databricks-based enterprise data platform for a Data & AI consultancy client. You will own solution design, deliver scalable data pipelines, and modernise data models with governance to support Power BI reporting.

The role combines hands-on delivery on 2-3 Databricks projects with client-facing delivery, governance, and deployment automation across a fully remote EU engagement. Fluency in French is required.

Qualifications

• 5+ years of professional Data Engineering experience.
• Hands-on delivery across Databricks projects.
• Experience with governance and data modelling practices.

Responsibilities

• Design and develop end-to-end data pipelines using Azure Databricks.
• Build and optimise Bronze, Silver and Gold data layers.
• Ingest data from SQL databases, REST APIs, SharePoint and file-based sources.
• Modernise Data Vault models into dimensional data models using Kimball methodology and SCD Type 2.
• Implement incremental data loading, schema evolution and CDC.
• Develop transformation, orchestration and data quality processes.
• Configure Unity Catalog governance, including access controls, masking and GDPR requirements.
• Implement CI/CD pipelines and Databricks deployment automation.
• Support Power BI reporting requirements.
• Collaborate with stakeholders throughout design and implementation.

Skills

Python

PySpark

SQL

Apache Spark

Databricks

Delta Lake

Unity Catalog

Medallion Architecture

GitHub

Azure DevOps

Tools

Azure Databricks

GitHub

Azure DevOps

Job description

Outside IR35 Contract | Fully Remote EU | Up to €500/day | November Start

We are looking for an experienced French-speaking Senior Data Engineer to support a major Databricks platform buildout for one of our Data & AI consultancy clients.

This is an opportunity to work on a new enterprise data platform, taking ownership of both solution design and hands‑on engineering.

The project will involve building scalable data pipelines, modernising existing data models, implementing governance and delivering a robust Gold layer to support Power BI reporting.

• Start: Early November 2026
• Duration: Approximately 20 weeks (until March 2027)
• Commitment: First 8 weeks full‑time, followed by 2-3 days per week
• Rate: Up to €600 per day
• Location: Fully remote (EMEA)

Key Responsibilities

• Design and develop end‑to‑end data pipelines using Azure Databricks.
• Build and optimise Bronze, Silver and Gold data layers.
• Ingest data from SQL databases, REST APIs, SharePoint and file‑based sources.
• Modernise existing Data Vault models into dimensional data models using Kimball methodology and SCD Type 2.
• Implement incremental data loading, schema evolution and change data capture (CDC).
• Develop transformation, orchestration and data quality processes.
• Configure Unity Catalog governance, including access controls, masking and GDPR requirements.
• Implement CI/CD pipelines and Databricks deployment automation.
• Support historical data migrations, reconciliation and Power BI reporting requirements.
• Collaborate with technical stakeholders throughout design and implementation.
• 5+ years of professional Data Engineering experience.
• 3+ years working within consultancy or client‑facing environments.
• Hands‑on delivery experience across at least 2-3 Databricks projects.
• Strong Python, PySpark, SQL and Apache Spark.
• Experience with Delta Lake, Unity Catalog and Medallion Architecture.
• Experience with Databricks Auto Loader, Lakeflow Jobs and Spark Declarative Pipelines.
• Experience with Azure services, including Entra ID, Key Vault and service principals.
• Practical experience with GitHub, Azure DevOps and CI/CD.
• Proven ability to design solutions and independently deliver production‑ready data pipelines.
• Experience migrating or simplifying existing Data Vault architectures.
• Databricks Asset Bundles and deployment automation.
• Advanced Unity Catalog governance and security.
• Experience supporting Power BI reporting layers.
• Knowledge of cross‑source entity matching and complex data reconciliation.