Lead Data Platform Engineer – Hybrid Cloud & Pipelines

Experian Information Solutions, Inc.; Nottingham; Hybrid; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Great compensation package

Pension

Bupa healthcare

Sharesave scheme

25 days annual leave

Job summary

Experian Credit Services & Verifications seeks a Lead Data Platform Engineer to join the Ascend Cloud Foundation Platform team in a hybrid Nottingham role (40% in the office).Reporting to the Engineering Director, you will lead an established agile team, drive data pipelines and data lake initiatives, and ensure high technical standards while aligning roadmaps with risk, security and compliance requirements.

Qualifications

• Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins, Harness.
• Strong experience of developing on Apache Spark/Hadoop.
• Strong experience with AWS cloud services including AWS Glue, S3, Step Functions.
• Experience building data pipelines and data lake.
• Experience with full development lifecycle/application Lifecycle Management Tools - BitBucket & Jira.
• Significant experience programming using Scala or Python.
• Knowledge of configuration as code principles and API integration.
• Ability to write clean, scalable, and reusable code that implements SOLID principles and adheres to coding standards.
• Experience analysing, investigating, and comparing large data sets.
• Experience with Functions, Lambdas, EventBridge, SQS, and Lake formation.
• Experience with automated testing methodologies.

Responsibilities

• Lead an outstanding Agile technical team.
• Build data pipelines and data lake.
• Deliver quality software.
• Collaborate with the risk, security and compliance teams to ensure adherence to regulatory requirements (e.g., GDPR, PCI DSS) and industry standards related to data privacy and security.
• Understand overlapping technical requirements across teams and help build technology roadmaps.
• Codebase ownership.
• Technical Application ownership.

Skills

Terraform

CI/CD

Git

Jenkins

Harness

Apache Spark

Hadoop

AWS

AWS Glue

S3

Scala

Python

Bitbucket

Jira

API Integration

SOLID Principles

Data Lake

Data Pipelines

Lambda

EventBridge

SQS

Testing

Tools

Bitbucket

Jira

Job description

Experian Credit Services & Verifications seeks a Lead Data Platform Engineer to join the Ascend Cloud Foundation Platform team in a hybrid Nottingham role (40% in the office).Reporting to the Engineering Director, you will lead an established agile team, drive data pipelines and data lake initiatives, and ensure high technical standards while aligning roadmaps with risk, security and compliance requirements.