Lead Data Platform Engineer — AWS/Spark, Hybrid (Nottingham)

Experian; Nottingham; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Discretionary bonus

25 days annual leave plus buy/sell

Pension and private healthcare

Job summary

Experian Credit Services & Verifications is recruiting a Lead Data Platform Engineer to provide hands-on technical leadership for a new fraud data capability within Experian's Data Analytics Platform. You will lead a team to deliver secure, scalable data pipelines and cloud components, collaborating with central platform teams and data owners.

This is a hybrid Nottingham based role with 40% office presence.

Qualifications

• Experience building data pipelines and data lake solutions.
• Strong AWS data engineering experience (Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge, SQS).
• DevOps and IaC tooling experience (Terraform, CI/CD, Git, Jenkins).
• Proficiency in Apache Spark or Hadoop.
• Programming experience in Scala or Python.
• Experience with API integration and configuration as code.
• Understanding of cloud security, data privacy, access control and governance.

Responsibilities

• Lead and support an agile technical team delivering data platform solutions for fraud-related data assets.
• Guide the delivery of AWS-based data pipelines and data lake components.
• Oversee handover, ownership and maintenance of pipelines and cloud components.
• Lead building, testing and maintaining high-quality data pipelines from Snowflake and internal platforms.
• Ensure metadata is prepared and published to surface assets through the DAP catalogue.
• Champion DevSecOps, CI/CD, IaC and cloud-native tooling for reliability and security.
• Mentor engineers, fostering innovation, learning and collaboration.
• Promote automation and AI-assisted development to improve speed and quality.

Skills

Data pipelines

AWS data services

DevSecOps

Terraform

CI/CD

Python/Scala

Spark/Hadoop

Security & governance

Kubernetes/OpenShift

APIs & integration

Tools

Terraform

OpenShift

Kubernetes

Jenkins

Git

Job description

Experian Credit Services & Verifications is recruiting a Lead Data Platform Engineer to provide hands-on technical leadership for a new fraud data capability within Experian's Data Analytics Platform. You will lead a team to deliver secure, scalable data pipelines and cloud components, collaborating with central platform teams and data owners.

This is a hybrid Nottingham based role with 40% office presence.