Senior Data Platform Engineer AWS, Spark

Experian Information Solutions, Inc.

City Of London

Hybrid

GBP 75,000 - 110,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Pension
Healthcare (Bupa)
Sharesave scheme
25 days annual leave
Discretionary bonus

Job summary

Experian Credit Services & Verifications seeks a Senior Data Platform Engineer to lead a new fraud data capability within Experian's Data Analytics Platform. The role is hands-on, balancing data engineering depth with cloud platform leadership and DevSecOps practices.

Based in Nottingham on a hybrid model (40% in office), you will influence technical roadmaps, drive CI/CD, IaC, and secure, scalable data solutions across stakeholders including data owners, security and compliance.

Qualifications

  • Experience building data pipelines and data lake solutions.
  • AWS cloud services experience for data engineering and platform delivery.
  • DevOps and Infrastructure as Code tooling like Terraform and CI/CD pipelines.
  • Experience developing on Apache Spark or Hadoop.
  • Programming in Scala or Python.
  • Understanding of cloud security, data privacy, access control and governance.

Responsibilities

  • Design, build, test and maintain AWS-based data pipelines for fraud data assets.
  • Support ingestion and transformation of data from Snowflake and internal systems.
  • Develop new data flows and automation as data assets onboard.
  • Ensure solutions follow security, governance and compliance patterns.
  • Contribute to technical design discussions and provide estimates.
  • Use IaC and CI/CD tooling to deliver repeatable solutions.
  • Produce documentation covering pipelines and procedures.
  • Support junior engineers and foster a quality engineering culture.
  • Apply modern engineering practices including automation and AI-assisted development.

Skills

Data pipelines
AWS data services
DevOps & IaC
Apache Spark/Hadoop
Scala or Python
Cloud security & governance

Tools

Terraform
CI/CD pipelines
Git
Jenkins
Apache Spark
Hadoop

Job description

Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries.

Internal Grade D/EB8

Job Description

Experian Credit Services & Verifications are looking for a Senior Data Platform Engineer to provide hands‑on technical leadership for a new fraud data capability that will connect fraud‑related data assets into Experian's Data Analytics Platform. You will work closely with the central Data Analytics Platform team, data owners, security, compliance, platform and delivery stakeholders to agree practical implementation approaches, align with established platform patterns, and ensure the team delivers secure, scalable and supportable solutions. This is a hands‑on engineering role suited to someone who can combine strong data engineering depth with cloud platform experience, engineering discipline and team leadership. You will apply effective DevSecOps practices and contribute to technical roadmap discussions where you will make effective use of CI/CD, Infrastructure as Code and cloud‑native tooling, and help drive automation and continuous improvement across the engineering lifecycle. This is a Hybrid, Nottingham based role (40% in the office) reporting to the Director of Engineering.

Key responsibilities
  • Design, build, test and maintain AWS-based data pipelines for fraud-related data assets.
  • Support ingestion and transformation of data from source platforms such as Snowflake and internal product/data systems.
  • Develop new data flows, integrations and automation as additional data assets are onboarded.
  • Work with platform, security and data stakeholders to ensure solutions follow agreed security, governance and compliance patterns.
  • Contribute to technical design discussions, review proposals, evaluate options, provide estimates and recommend practical solutions.
  • Use Infrastructure as Code and Configuration as Code tooling, such as Terraform, Git and CI/CD pipelines, to deliver repeatable solutions.
  • Produce clear documentation covering pipelines, data flows, operational procedures and support processes.
  • Support junior engineers where appropriate and contribute to a collaborative, quality-focused engineering culture.
  • Use modern engineering practices, including automation and AI‑assisted development where appropriate, to improve delivery speed, quality and repeatability.
Qualifications
  • Strong experience building data pipelines, data lake solutions or data platform capabilities.
  • Strong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
  • Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.
  • Strong experience developing on Apache Spark or Hadoop.
  • Significant programming experience using Scala or Python.
  • Strong understanding of cloud security, data privacy, access control and governance principles in data platform environments.
Desired skills
  • AWS Developer Certification or other relevant AWS certification.
  • Strong expertise in Terraform or CloudFormation.
  • Experience with OpenShift or Kubernetes.
  • Experience with automated testing tools such as pytest or Scalatest.
  • Knowledge of RESTful APIs and microservice architectures.
  • Experience working with sensitive, governed or regulated data environments.
  • Familiarity with data catalogue, metadata management, data marketplace or federated data mesh concepts.
Additional Information

Great compensation package and discretionary bonus planCore benefits include pension, bupa healthcare, sharesave scheme and more25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.

Recruitment Fraud Awareness

Recruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address. Experian will never ask candidates to make any payment as part of an application, interview, assessment, onboarding, or recruitment process. To apply for roles or verify opportunities, please visit experian.com/careers. Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces 2025 (Fortune Global Top 25), Great Place To Work in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affinite Action employer. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers -

Creating a better tomorrow togetherFind out what its like to work for Experian by clicking here

Summary

Type: Full-timeFunction: EngineeringExperience level: Not ApplicableIndustry: Financial Services

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Platform Engineer - AWS, Spark
Lead Data Platform Engineer - AWS, Spark

Experian • Nottingham

Hybrid
GBP 90,000 - 130,000
Discretionary bonus
25 days annual leave plus buy/sell
Pension and private healthcare
Lead Data Platform Engineer - AWS, Spark
Lead Data Platform Engineer - AWS, Spark

Experian Information Solutions, Inc. • City Of London

Hybrid
GBP 90,000 - 130,000
Great compensation package
Discretionary bonus plan
25 days annual leave
+3
Senior Data Platform Engineer (AWS Spark) – Fraud Data
Senior Data Platform Engineer (AWS Spark) – Fraud Data

Experian Information Solutions, Inc. • City Of London

Hybrid
GBP 75,000 - 110,000
Pension
Healthcare (Bupa)
Sharesave scheme
+2
Lead Data Platform Engineer — AWS/Spark, Hybrid (Nottingham)
Lead Data Platform Engineer — AWS/Spark, Hybrid (Nottingham)

Experian • Nottingham

Hybrid
GBP 90,000 - 130,000
Discretionary bonus
25 days annual leave plus buy/sell
Pension and private healthcare
Lead Data Platform Engineer - AWS, Spark, DevSecOps
Lead Data Platform Engineer - AWS, Spark, DevSecOps

Experian Information Solutions, Inc. • City Of London

Hybrid
GBP 90,000 - 130,000
Great compensation package
Discretionary bonus plan
25 days annual leave
+3
Financial Crime Compliance Delivery Lead
Financial Crime Compliance Delivery Lead

Experian • Nottingham

Hybrid
GBP 65,000 - 90,000
Great compensation and discretionary bonus
Core benefits include pension and healthcare
25 days annual leave with bank holidays
+3
Senior FullStack Engineer - TypeScript - Python
Senior FullStack Engineer - TypeScript - Python

Experian • Greater London

Hybrid
GBP 65,000 - 90,000
Hybrid work
Bonus plan
Pension & healthcare
+1
Senior FullStack Engineer - TypeScript - Python
Senior FullStack Engineer - TypeScript - Python

Product HQ • Greater London

Hybrid
GBP 60,000 - 90,000
Hybrid-based role (40% office)
Discretionary bonus
Pension
+2
Senior Insider Risk Specialist
Senior Insider Risk Specialist

Experian • Nottingham

Hybrid
GBP 70,000 - 100,000
Pension
Healthcare (Bupa)
Sharesave
+2
Senior Data Engineer
Senior Data Engineer

LT Harper - Cyber Security Recruitment • England

On-site
GBP 55,000 - 75,000