Hybrid Senior AWS Spark Data Platform Engineer

Experian; Nottingham; Hybrid; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Discretionary bonus

Pension

Healthcare

Sharesave scheme

Annual leave + volunteering days

Job summary

Experian Credit Services & Verifications is seeking a Senior Data Platform Engineer to lead a new fraud data capability within Experian's Data Analytics Platform. The role combines data engineering depth with cloud platform experience and hands-on leadership.

The successful candidate will design and build AWS-based data pipelines, apply DevSecOps practices, and collaborate with data owners, security and platform teams to deliver secure, scalable solutions in a hybrid Nottingham-based role.

Qualifications

• Strong experience building data pipelines, data lake solutions or data platform capabilities.
• Strong experience with AWS cloud services relevant to data engineering and platform delivery, including AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
• Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.
• Strong experience developing on Apache Spark or Hadoop.
• Significant programming experience using Scala or Python.
• Strong understanding of cloud security, data privacy, access control and governance principles in data platform environments

Responsibilities

• Design, build, test and maintain AWS-based data pipelines for fraud-related data assets.
• Support ingestion and transformation of data from source platforms such as Snowflake and internal product/data systems.
• Develop new data flows, integrations and automation as additional data assets are onboarded.
• Work with platform, security and data stakeholders to ensure solutions follow agreed security, governance and compliance patterns.
• Contribute to technical design discussions, review proposals, evaluate options, provide estimates and recommend practical solutions.
• Use Infrastructure as Code and Configuration as Code tooling, such as Terraform, Git and CI/CD pipelines, to deliver repeatable solutions.
• Produce clear documentation covering pipelines, data flows, operational procedures and support processes.
• Support junior engineers where appropriate and contribute to a collaborative, quality-focused engineering culture.
• Use modern engineering practices, including automation and AI-assisted development where appropriate, to improve delivery speed, quality and repeatability.

Skills

Data pipelines

AWS

Terraform

Spark

Hadoop

Python

Scala

DevSecOps

CI/CD

Git

Jenkins

OpenShift

Kubernetes

Snowflake

S3

Education

Bachelor's degree in a relevant field

Tools

Terraform

Git

Jenkins

OpenShift

Kubernetes

Snowflake

S3

Job description

Experian Credit Services & Verifications is seeking a Senior Data Platform Engineer to lead a new fraud data capability within Experian's Data Analytics Platform. The role combines data engineering depth with cloud platform experience and hands-on leadership.

The successful candidate will design and build AWS-based data pipelines, apply DevSecOps practices, and collaborate with data owners, security and platform teams to deliver secure, scalable solutions in a hybrid Nottingham-based role.