Lead Data Platform Engineer

Experian; India; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

Experian is seeking a Lead Data Platform Engineer to act as a hands‑on technical leader for our data platform engineering function. You will design, build scalable data platforms and drive engineering best practices across the team.

You will shape our AWS‑native data ecosystem, mentor engineers, and ensure delivery of high‑quality data solutions. This role is #LI-hybrid based in Hyderabad.

Qualifications

• 8+ years in Data Platform engineering or equivalent.
• Experience at lead or principal engineer level in enterprise settings.
• Extensive hands-on AWS data services experience (Glue, Step Functions, Lake Formation, EventBridge, Lambda, Datazone, CloudWatch).
• Strong data pipelines and data lake design/build capability.
• Solid DevOps background with IaC (Terraform) and CI/CD tooling (Git, Jenkins).
• Proficient in Python; experience with API integrations and automated testing.

Responsibilities

• Be a hands-on technical lead across data engineering workstreams, setting direction and standards.
• Design, build, and optimize data lake architectures using a data mesh model.
• Develop and maintain AWS-native data platforms with modern cloud services.
• Implement DevOps best practices, including IaC with Terraform and CI/CD pipelines.
• Embed automated testing, monitoring, and data quality frameworks into the lifecycle.
• Provide guidance and mentoring to engineers within the team.
• Collaborate with cross-functional stakeholders to deliver robust data solutions.
• Troubleshoot and optimize data workflows for performance and scale.

Skills

AWS data services

Data pipelines

Data lake solutions

Terraform

CI/CD pipelines

Git/Jenkins

Python

API integrations

Mentoring

Agile delivery

Tools

Jenkins

Git

Terraform

Job description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.co

We are seeking a Lead Data Platform Engineer to act as a hands‑on technical leader for our data platform engineering function.

You will be #LI-hybrid based in Hyderabad and reporting to Director Engineering.

You will be responsible for designing, building scalable data platforms while driving engineering best practices across the team.

You will help shape our AWS‑native data ecosystem, mentor engineers, and ensure the delivery of high‑quality, reliable data solutions.

Key Responsibilities

• Be a hands‑on technical lead across data engineering workstreams, setting direction and standards
• You will Design, build, and optimise data lake architectures using a data mesh model
• Develop and maintain AWS‑native data platforms using modern cloud services
• Implement DevOps best practices, including Infrastructure-as-Code (IaC) using Terraform and CI/CD pipelines
• Apply configuration-as-code principles consistently across all environments.
• Embed automated testing, monitoring, and data quality frameworks into the development lifecycle
• Provide guidance, and mentoring to engineers within the team
• Collaborate with cross‑functional stakeholders to deliver robust and scalable data solutions
• Troubleshoot and optimize data workflows to ensure performance, reliability, and scalability

Qualifications

• 8+ years of relevant experience in Data Platform engineering
• Proven experience at Lead or Principal Engineer level within a large or enterprise environment
• Extensive hands‑on experience with AWS data services, including:
  • Glue
  • Step Functions
  • Lake Formation
  • EventBridge
  • Lambda
  • Datazone
  • Cloudwatch
• Strong experience designing and building data pipelines and data lake solutions
• Solid DevOps expertise, including:
  • Terraform (Infrastructure-as-Code)
  • CI/CD pipelines
  • Git and Jenkins
• Working knowledge of AWS SageMaker Unified Studio
• Advanced programming skills in Python
• Experience with API integrations and configuration-as-code approaches
• I nvestigate and reconcile complex workflows
• Proven experience implementing automated testing frameworks within data engineering workflows

Desirable Attributes

• Continuous improvement and Innovation
• Experience working in agile delivery environments
• Passion for mentoring and developing engineering talent

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is a critical part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, color, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Benefits

Experian cares for employee’s work life balance, health, safety and wellbeing. In support of this endeavor, we offer best‑in‑class family well‑being benefits, enhanced medical benefits and paid time off.

This is a hybrid remote/in‑office role.