Lead Data Platform Engineer

Experian; Hyderabad; Hybrid; INR 3,500,000 - 6,000,000; Full time

Benefits offered by this job

Hybrid role (remote/in-office)

Enhanced medical coverage

Paid time off

Well-being benefits

Job summary

Experian in Hyderabad seeks a Lead Data Platform Engineer to drive the design, build and optimization of AWS-native data platforms. You will mentor engineers, set standards, and collaborate with cross-functional teams to deliver scalable data solutions.

The role requires extensive AWS data services experience and strong Python/DevOps skills, with a hands-on leadership style and a focus on data quality and reliability.

Qualifications

• 8+ years of experience in Data Platform engineering.
• Lead or Principal Engineer experience in a large/enterprise environment.
• Extensive hands-on experience with AWS data services (Glue, Step Functions, Lake Formation, EventBridge, Lambda, Datazone, CloudWatch).
• Experience designing/building data pipelines and data lake solutions.
• DevOps expertise: Terraform, CI/CD pipelines, Git, Jenkins.
• Knowledge of AWS SageMaker Unified Studio.

Responsibilities

• Be a hands-on technical lead across data engineering workstreams, setting direction and standards.
• Design, build, and optimise data lake architectures using a data mesh model.
• Develop and maintain AWS-native data platforms using modern cloud services.
• Implement DevOps best practices, including IaC using Terraform and CI/CD pipelines.
• Apply configuration-as-code across environments.
• Embed automated testing, monitoring, and data quality frameworks.
• Provide guidance and mentoring to engineers.
• Collaborate with stakeholders to deliver robust data solutions.
• Troubleshoot and optimise data workflows for performance and reliability.

Skills

Cloud AWS

Python

Terraform

CI/CD

Data Mesh

Data Lake

SageMaker

API Integration

Tools

Git

Jenkins

Terraform (IaC)

Job description

Overview

Lead Data Platform Engineer role based in Hyderabad, reporting to the Director of Engineering. The engineer will act as a hands-on technical leader for the data platform engineering function and be responsible for designing, building scalable data platforms while driving engineering best practices across the team. You will help shape the AWS-native data ecosystem, mentor engineers, and ensure the delivery of high-quality, reliable data solutions.

Responsibilities

• Be a hands-on technical lead across data engineering workstreams, setting direction and standards
• Design, build, and optimise data lake architectures using a data mesh model
• Develop and maintain AWS-native data platforms using modern cloud services
• Implement DevOps best practices, including Infrastructure-as-Code (IaC) using Terraform and CI/CD pipelines
• Apply configuration-as-code principles consistently across all environments
• Embed automated testing, monitoring, and data quality frameworks into the development lifecycle
• Provide guidance and mentoring to engineers within the team
• Collaborate with cross-functional stakeholders to deliver robust and scalable data solutions
• Troubleshoot and optimise data workflows to ensure performance, reliability, and scalability

Qualifications

• 8+ years of relevant experience in Data Platform engineering
• Proven experience at Lead or Principal Engineer level within a large or enterprise environment
• Extensive hands-on experience with AWS data services, including Glue, Step Functions, Lake Formation, EventBridge, Lambda, Datazone, CloudWatch
• Strong experience designing and building data pipelines and data lake solutions
• Solid DevOps expertise, including Terraform (Infrastructure-as-Code), CI/CD pipelines, Git and Jenkins
• Working knowledge of AWS SageMaker Unified Studio
• Advanced programming skills in Python
• Experience with API integrations and configuration-as-code approaches
• Investigate and reconcile complex workflows
• Proven experience implementing automated testing frameworks within data engineering workflows

Desirable Attributes

• Continuous improvement and Innovation
• Experience working in agile delivery environments
• Mentoring and developing engineering talent

Additional Information

Experian’s culture emphasizes DEI, work/life balance, development, authenticity, collaboration, wellness, reward and recognition, volunteering, and a people-first approach. The company holds multiple awards including World’s Best Workplaces and Great Place To Work in various regions. Equal Opportunity and Affirmative Action employer. If you have a disability or special need requiring accommodation, please inform us at the earliest opportunity.

Benefits

Experian offers benefits focused on work-life balance, health, safety and well-being, including family well-being benefits, enhanced medical coverage, and paid time off. This is a hybrid remote/in-office role.

Recruitment Fraud Awareness: Experian’s recruitment process uses authorised channels and official emails. We never ask candidates to make any payment as part of the application or recruitment process. To apply for roles or verify opportunities, visit experian.com/careers.