Lead Data Platform Engineer - AWS, Spark, DevSecOps

Experian Information Solutions, Inc.

City Of London

Hybrid

GBP 90,000 - 130,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Great compensation package
Discretionary bonus plan
25 days annual leave
Pension
Bupa healthcare
Sharesave scheme

Job summary

Experian is seeking a Lead Data Platform Engineer to provide hands-on technical leadership for a fraud data capability within the Data Analytics Platform. You will guide a team to deliver secure, scalable data pipelines and cloud components, collaborating with central platform teams and data owners.

The role combines data engineering depth with cloud platform experience, DevSecOps discipline and mentoring across engineers, with a hybrid Nottingham-based work pattern (40% in the office).

Qualifications

  • Experience building data pipelines and data-lake solutions or data platform capabilities.
  • Experience with AWS data engineering services (Glue, S3, Step Functions, IAM, Lake Formation).
  • Proficiency in Scala or Python for data processing.
  • DevSecOps practices and Infrastructure as Code (Terraform, CI/CD).
  • Understanding cloud security, governance, and data privacy in platforms.

Responsibilities

  • Lead and support an agile technical team delivering data platform solutions for fraud data assets.
  • Guide the delivery of AWS-based data pipelines and data-lake components.
  • Oversee handover, ownership, maintenance and enhancements of pipelines from central DAP team.
  • Lead building, testing and maintaining data pipelines from Snowflake and internal platforms.
  • Ensure metadata is published and surfaced in the DAP catalogue.
  • Champion DevSecOps, CI/CD, IaC and cloud-native tooling to improve reliability and security.
  • Mentor and coach engineers, promoting learning and collaboration.

Skills

Data pipelines
AWS data services
DevOps / IaC
Spark / Hadoop
Scala or Python
API integration
Cloud security & governance
Mentoring

Tools

Terraform
CI/CD
Git
Jenkins
OpenShift
Kubernetes
Snowflake
S3
Lambda
EC2

Job description

Experian is seeking a Lead Data Platform Engineer to provide hands-on technical leadership for a fraud data capability within the Data Analytics Platform. You will guide a team to deliver secure, scalable data pipelines and cloud components, collaborating with central platform teams and data owners.

The role combines data engineering depth with cloud platform experience, DevSecOps discipline and mentoring across engineers, with a hybrid Nottingham-based work pattern (40% in the office).

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Platform Engineer — AWS/Spark, Hybrid (Nottingham)
Lead Data Platform Engineer — AWS/Spark, Hybrid (Nottingham)

Experian • Nottingham

Hybrid
GBP 90,000 - 130,000
Discretionary bonus
25 days annual leave plus buy/sell
Pension and private healthcare
Senior Data Platform Engineer (AWS Spark) – Fraud Data
Senior Data Platform Engineer (AWS Spark) – Fraud Data

Experian Information Solutions, Inc. • City Of London

Hybrid
GBP 75,000 - 110,000
Pension
Healthcare (Bupa)
Sharesave scheme
+2
Lead Data Platform Engineer - AWS, Spark
Lead Data Platform Engineer - AWS, Spark

Experian Information Solutions, Inc. • City Of London

Hybrid
GBP 90,000 - 130,000
Great compensation package
Discretionary bonus plan
25 days annual leave
+3
Lead Data Platform Engineer - AWS, Spark
Lead Data Platform Engineer - AWS, Spark

Experian • Nottingham

Hybrid
GBP 90,000 - 130,000
Discretionary bonus
25 days annual leave plus buy/sell
Pension and private healthcare
Senior Data Platform Engineer AWS, Spark
Senior Data Platform Engineer AWS, Spark

Experian Information Solutions, Inc. • City Of London

Hybrid
GBP 75,000 - 110,000
Pension
Healthcare (Bupa)
Sharesave scheme
+2
Lead Data Engineer
Lead Data Engineer

Forsyth Barnes • Greater London

Hybrid
GBP 70,000 - 90,000
Lead Data Engineer - AWS Lakehouse & Real-Time Pipelines
Lead Data Engineer - AWS Lakehouse & Real-Time Pipelines

MRJ Recruitment • Manchester

Hybrid
GBP 95,000 - 105,000
Lead Data Engineer (SC Cleared) — AWS, Spark, Lakehouse
Lead Data Engineer (SC Cleared) — AWS, Spark, Lakehouse

Credera • Newcastle upon Tyne

On-site
GBP 84,000 - 100,000
Competitive salary
Comprehensive benefits
Personalised development opportunities
Lead Data Engineer - Perm - AWS Migration
Lead Data Engineer - Perm - AWS Migration

Lorien • Manchester

Hybrid
GBP 85,000 - 100,000
Lead Data Engineer
Lead Data Engineer

Anson McCade Pty • Greater London

On-site
GBP 110,000 - 150,000