Principal Data Engineer: Lead Decisioning Pipelines

Hitachi, Ltd.; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

GlobalLogic is seeking an experienced Principal Data Engineer to own the customer decisioning pipeline architecture, end-to-end orchestration, and production readiness. You will lead real-world targeting and eligibility rule implementations, ensure robust data quality, and oversee critical downstream activation.

You will implement scalable data pipelines, review complex business logic for eligibility, and drive standards for testing and incident response, with a focus on CI/CD practices and

Qualifications

• Extensive experience building large-scale data engineering solutions using SQL, Python, Spark and Databricks.
• Proven ability to design resilient workflows with strict dependency management and idempotent processing.
• Experience establishing robust CI/CD practices with Git and Azure DevOps.
• Track record of supporting production systems with automated data quality checks, reconciliation, and incident diagnosis.
• Familiarity with CRM decisioning engines, marketing consent frameworks, or platform integrations like Comarch and Salesforce Marketing Cloud.

Responsibilities

• Design, build, and optimize scalable data pipelines with reliable scheduled and event-triggered workflows.
• Implement and review complex business logic for customer eligibility, contact policies, suppression rules, and cooldown periods.
• Oversee downstream activation datasets, file manifests, delivery status tracking, and secure SFTP platform integrations.
• Drive engineering standards by reviewing pull requests and enforcing unit, integration, and regression testing across environments.
• Lead production cutovers, automated alerting, disaster recovery, data reconciliation, and technical incident response.

Skills

Data engineering

SQL

Python

Apache Spark

Databricks

CI/CD practices

Code reviews

Incident diagnosis

Tools

Git

Azure DevOps

Comarch

Salesforce Marketing Cloud

Job description

GlobalLogic is seeking an experienced Principal Data Engineer to own the customer decisioning pipeline architecture, end-to-end orchestration, and production readiness. You will lead real-world targeting and eligibility rule implementations, ensure robust data quality, and oversee critical downstream activation.

You will implement scalable data pipelines, review complex business logic for eligibility, and drive standards for testing and incident response, with a focus on CI/CD practices and