Hybrid Belfast: Principal Data Platform Engineer

Blackduck; Belfast City District; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

Black Duck Software, Inc. is seeking a senior data engineering lead to design and build cross-product data services from a single governed data plane in a hybrid Belfast environment.

You will define the customer data plane, standardize identifiers, and enable ingestion patterns for batch, streaming, and event data with reliable onboarding. You will own data reliability playbooks, enforce data contracts, quality checks, lineage, and security, while productizing data offerings and ensuring ML/AI

Qualifications

• Significant experience building production data platforms at scale.
• Strong SQL and Python for pipelines and automation.
• Cloud experience with AWS and Google Cloud.
• Experience with both transactional and analytics stores.
• Familiarity with ML data needs and AI workflows.
• Ability to balance latency, accuracy, cost, and security.

Responsibilities

• Lead design and build-out of cross-product data services.
• Define the customer data plane model with canonical identifiers.
• Build ingestion patterns for batch, streaming, and event data.
• Own data reliability playbook: contracts, quality checks, lineage, monitoring.
• Productize data products with documentation and ownership.
• Collaborate with product, engineering, and security stakeholders.

Skills

SQL

Python

Cloud platforms

Data modeling

Data pipelines

On-call ownership

ML data needs

Tools

RDS-style databases

OLAP stores

Lakehouse architectures

Open table formats

Airflow

Streaming systems

Data contracts tooling

Job description

Black Duck Software, Inc. is seeking a senior data engineering lead to design and build cross-product data services from a single governed data plane in a hybrid Belfast environment.

You will define the customer data plane, standardize identifiers, and enable ingestion patterns for batch, streaming, and event data with reliable onboarding. You will own data reliability playbooks, enforce data contracts, quality checks, lineage, and security, while productizing data offerings and ensuring ML/AI