Lead Data Platform Engineer - AWS Spark (Fraud Data)

Experian; Nottingham; Hybrid; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Discretionary bonus

Pension

Bupa healthcare

25 days annual leave

Job summary

Experian Credit Services & Verifications is seeking a Lead Data Platform Engineer in Nottingham to provide hands-on technical leadership for a fraud data capability within Experian’s Data Analytics Platform.

You will lead a small team, build AWS-based data pipelines, promote DevSecOps practices, and collaborate with central platform teams to deliver secure, scalable solutions with modern engineering practices. This hybrid role requires 40% office presence in Nottingham.

Qualifications

• Extensive experience building data pipelines and data lake solutions.
• Hands-on AWS data engineering including Glue, S3 and Lambda.
• Strong DevSecOps focus with IaC and CI/CD pipelines.
• Experience with Spark or Hadoop.
• Proficient in Scala or Python.
• Knowledge of data security, governance and privacy.

Responsibilities

• Lead and mentor an agile technical team delivering data platform solutions for fraud-related data assets.
• Guide AWS-based data pipelines and data lake components.
• Handover and maintain pipelines and cloud components from central DAP team.
• Develop high-quality data pipelines from source systems such as Snowflake.
• Ensure metadata surfaces via the DAP catalogue.
• Champion DevSecOps, CI/CD, IaC and cloud-native tooling.
• Mentor engineers and foster innovation and collaboration.
• Promote automation and AI-assisted development to improve delivery speed.

Skills

Data pipelines

AWS data engineering

DevSecOps

Team leadership

Cloud platforms

Scala or Python

Terraform

CI/CD

Tools

AWS

Terraform

OpenShift/Kubernetes

Spark/Hadoop

Python/Scala

Snowflake

Job description

Experian Credit Services & Verifications is seeking a Lead Data Platform Engineer in Nottingham to provide hands-on technical leadership for a fraud data capability within Experian’s Data Analytics Platform.

You will lead a small team, build AWS-based data pipelines, promote DevSecOps practices, and collaborate with central platform teams to deliver secure, scalable solutions with modern engineering practices. This hybrid role requires 40% office presence in Nottingham.