Lead Data Platform Engineer -12 Month Secondment

Experian Group; Nottingham; On-site; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Pension

Healthcare

Sharesave

Annual leave

Job summary

Experian is seeking a Lead Data Platform Engineer for our Ascend Cloud Foundation Platform team in a hybrid Nottingham setting (40% in the office). The role leads an Agile team to build data pipelines and data lakes, delivering scalable software while adhering to regulatory standards.

You’ll own the codebase, drive DevOps practices with Terraform, CI/CD, Jenkins and Harness, and work with Spark/Hadoop and AWS services like Glue, S3, and Lake formation.

Qualifications

• Proven experience leading an Agile data platform team.
• Strong background building data pipelines and data lakes.
• Expertise with Spark/Hadoop and AWS services.
• Experience with Terraform, CI/CD, and code reviews.

Responsibilities

• Lead an Agile technical team and drive technical standards.
• Build data pipelines and data lake infrastructure.
• Deliver high-quality software in regulated environments.
• Collaborate with risk, security and compliance teams on GDPR/PCI DSS.
• Own codebase and application lifecycle management tools.

Skills

Agile leadership

Data engineering

AWS

Scala/Python

DevOps

Terraform

CI/CD

Spark/Hadoop

Data governance

Education

Bachelor's degree in CS

Tools

Terraform

Jenkins

Harness

Bitbucket

Jira

AWS S3

AWS Glue

Job description

Experian Credit Services & Verifications are looking for a Lead Data Platform Engineer to join our Ascend Cloud Foundation Platform team for a 12 month fixed-term contract. Reporting into our Engineering Director, you will join an established agile team, with a passion and lead a technical team that supports innovation, learning and collaboration. Ensure that the team follows the highest technical standards. Support Agile methods to deliver high value outcomes.

This is a Hybrid, Nottingham based role (40% in the office).

Main responsibilities:

• Lead an outstanding Agile technical team
• Build data pipelines and data lake
• Deliver quality software
• Collaborate with the risk, security and compliance teams to ensure adherence to regulatory requirements (e.g., GDPR, PCI DSS) and industry standards related to data privacy and security
• Understand where there are overlapping technical requirements in your team and other teams and help build out technology roadmaps
• Codebase ownership
• Technical Application ownership
• Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins, Harness
• Strong experience of developing on Apache Spark/Hadoop
• Strong experience with AWS cloud services including AWS Glue, S3, Step
• Strong experience building data pipelines and data lake
• Experience of the full development lifecycle/application Lifecycle Management Tools - BitBucket & Jira
• Significant experience of programming using Scala or Python. Configuration as code principles and API integration
• Write clean, scalable and re-usable code that implements SOLID principles, common design patterns where applicable and adheres to published coding standards
• Experience analyse, investigate and compare large data sets when required
• Functions, Lambdas, EventBridge, SQS and Lake formation
• Experience with automated testing methodologies

Benefits package includes:

• Great compensation package and discretionary bonus plan
• Core benefits include pension, bupa healthcare, sharesave scheme and more
• 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.

Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces 2025 (Fortune Global Top 25), Great Place To Work 26 countries to name a few.

Experian is also proud to be an Equal Opportunity and Aff…

If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.