Senior Data Engineer

Hitachi, Ltd.; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

GlobalLogic is seeking an experienced Principal Data Engineer to own the customer decisioning pipeline architecture, end-to-end orchestration, and production readiness. You will lead real-world targeting and eligibility rule implementations, ensure robust data quality, and oversee critical downstream activation.

You will implement scalable data pipelines, review complex business logic for eligibility, and drive standards for testing and incident response, with a focus on CI/CD practices and

Qualifications

• Extensive experience building large-scale data engineering solutions using SQL, Python, Spark and Databricks.
• Proven ability to design resilient workflows with strict dependency management and idempotent processing.
• Experience establishing robust CI/CD practices with Git and Azure DevOps.
• Track record of supporting production systems with automated data quality checks, reconciliation, and incident diagnosis.
• Familiarity with CRM decisioning engines, marketing consent frameworks, or platform integrations like Comarch and Salesforce Marketing Cloud.

Responsibilities

• Design, build, and optimize scalable data pipelines with reliable scheduled and event-triggered workflows.
• Implement and review complex business logic for customer eligibility, contact policies, suppression rules, and cooldown periods.
• Oversee downstream activation datasets, file manifests, delivery status tracking, and secure SFTP platform integrations.
• Drive engineering standards by reviewing pull requests and enforcing unit, integration, and regression testing across environments.
• Lead production cutovers, automated alerting, disaster recovery, data reconciliation, and technical incident response.

Skills

Data engineering

SQL

Python

Apache Spark

Databricks

CI/CD practices

Code reviews

Incident diagnosis

Tools

Git

Azure DevOps

Comarch

Salesforce Marketing Cloud

Job description

Job Description

We are looking for an experienced Principal Data Engineer to take technical ownership of our customer decisioning pipeline architecture, end-to-end orchestration, and production readiness.

In this role, you will lead the implementation of real-world targeting and eligibility rules, ensure bulletproof data quality, and oversee mission-critical downstream activation.

Requirements

• You have deep expertise in building large-scale data engineering solutions using SQL, Python, Apache Spark, and Databricks.
• You bring proven experience designing resilient workflows with strict dependency management and idempotent processing.
• You are comfortable establishing robust CI/CD practices, conducting code reviews, and managing releases using Git and Azure DevOps.
• You have a track record of supporting production systems with automated data quality checks, reconciliation routines, and incident diagnosis.
• You ideally bring familiarity with CRM decisioning engines, marketing consent frameworks, or platform integrations like Comarch and Salesforce Marketing Cloud.

Job Responsibilities

• Design, build, and optimize scalable data pipelines that run on reliable scheduled and event-triggered workflows.
• Implement and review complex business logic for customer eligibility, contact policies, suppression rules, and cooldown periods.
• Oversee downstream activation datasets, file manifests, delivery status tracking, and secure SFTP platform integrations.
• Drive engineering standards by reviewing pull requests and enforcing rigorous unit, integration, and regression testing across environments.
• Lead production cutovers, automated alerting, disaster recovery, data reconciliation, and technical incident response.

What we offer

Why work at GlobalLogic

Our goal is to build an inclusive positive culture where everyone can feel comfortable being themselves, empowering our people to create their own high standards and therefore more value. We work together to promote fairness while recognising, valuing and embracing differences – providing a transparent support structure and generous training budget to help our people develop skills to progress their career. Our region also supports a hybrid model which can flex across a wide spectrum of working options determined by our business, customer and individual needs.

• You’ll benefit from a comprehensive health and wellness plan, private healthcare (clinical and mental wellbeing), and discounted gym memberships.
• We offer a fantastic benefits package including a competitive pension scheme and recognition schemes through bonus/reward initiatives.
• Colleagues are entitled to an annual volunteering day – so you can take time to support a cause close to your heart.
• We also love to stay social at our trips to the zoo, quiz nights, sports events, theatre trips and much more.

We are an equal opportunities employer. It is our policy to promote an environment free from discrimination, harassment and victimisation.

About GlobalLogic

GlobalLogic is a full-lifecycle product development services leader that combines chip-to-cloud software engineering expertise and vertical industry experience to help our customers design, build, and deliver their next-generation products and digital experiences. We expertly integrate design, complex engineering, and agile delivery capabilities to deliver superior business outcomes for global brands in telecom, automotive, healthcare, technology, media and entertainment, manufacturing, and semiconductor industries.

Headquartered in Silicon Valley, GlobalLogic employs over 25,000 designers and engineers across the globe. Analysts like NASSCOM and Zinnov have recognized us for being a top company in our field, and we are consistently nominated as a preferred employer by both global HR consultative firms and local job boards. By creating a work environment that is exciting and flexible, and by fostering growth through ongoing learning and development programs, we empower our employees to achieve both their professional and personal goals.

At GlobalLogic, we make amazing products — and careers.