Senior Data Engineering Lead

Experian; Hyderabad; Hybrid; INR 4,500,000 - 7,500,000; Full time

Benefits offered by this job

Best-in-class family well-being

Job summary

Experian Hyderabad seeks a senior engineering leader to define and deliver a modern, cloud-based data platform that powers analytics, AI, and strategic decision-making across the organization.

You will lead multidisciplinary teams to design scalable batch and streaming pipelines on AWS, establish data governance and reliability standards, and drive platform modernization to improve data access, security, and operational efficiency while enabling future AI capabilities.

Qualifications

• 10+ years of experience in Data Engineering, Software Engineering, or Platform Engineering with leadership responsibility.
• Proven experience designing and operating large-scale batch and streaming data platforms using Spark, Kafka, Kinesis, Flink or equivalent.
• Strong expertise in AWS data, compute, orchestration and infrastructure components.
• Experience building data lake/warehouse/lakehouse solutions using Snowflake, Databricks, Redshift, Athena, Iceberg, Delta Lake or similar.
• Hands-on CI/CD, Infrastructure as Code, containerized platforms, and automation practices.

Responsibilities

• Lead the design and delivery of scalable batch and streaming data platforms that support analytics, reporting, and AI use cases.
• Mentor teams across Data Engineering, Platform Engineering, and DevOps while establishing standards and roadmaps.
• Build reliable data pipelines with governance, observability, security, and data quality practices.
• Drive cloud platform modernization using AWS services, automation, CI/CD, and event-driven architectures.
• Partner with Product, Architecture, Governance, and Business teams to align investments with goals.

Skills

Data platform leadership

AWS expertise

Data pipelines

Governance & security

People leadership

Tools

Apache Spark

Kafka

Kinesis

Flink

Snowflake

Databricks

Redshift

Iceberg

Delta Lake

CI/CD

IaC

Job description

Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries

Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries

Job Description

We are looking for a senior engineering leader to define and deliver a modern, cloud-based data platform that powers analytics, AI, and business decision-making across the organization.

This role is responsible for building scalable batch and real-time data pipelines, establishing data governance and reliability standards, and driving platform modernization on AWS.

The successful candidate will lead multidisciplinary engineering teams, shape the data platform strategy, and deliver secure, high-performing solutions that improve data accessibility, operational efficiency, and business outcomes while enabling future AI-driven capabilities.

What You'll Be Doing

• This role is Hyderabad based and reporting to Director Engineering
• You will lead the design and delivery of scalable batch and streaming data platforms that support analytics, reporting, and AI use cases.
• Manage and mentor teams across Data Engineering, Platform Engineering, and DevOps while establishing engineering standards, reusable frameworks, and delivery roadmaps.
• You will build reliable data pipelines with strong governance, observability, security, and data quality practices to ensure trusted and compliant data products.
• Drive cloud platform modernization using AWS services, infrastructure automation, CI/CD practices, and event-driven architectures.
• Partner with Product, Architecture, Governance, and Business teams to prioritize initiatives, manage delivery risks, and align platform investments with business goals.

Qualifications

What We're Looking For

• 10+ years of experience in Data Engineering, Software Engineering, or Platform Engineering, including leadership responsibility for engineering teams.
• Proven experience designing and operating large-scale batch and streaming data platforms using technologies such as Apache Spark, Kafka, Kinesis, Flink, or equivalent.
• Strong expertise in AWS cloud services, including data, compute, orchestration, and infrastructure components.
• Experience building modern data lake, warehouse, or lakehouse solutions using technologies such as Snowflake, Databricks, Redshift, Athena, Iceberg, Delta Lake, or similar platforms.
• Hands-on experience with CI/CD, Infrastructure as Code, containerized platforms, and engineering automation practices.
• Experience implementing data governance, observability, security, and compliance controls, including data quality frameworks and regulated data management.

Additional Information

Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces™ 2025 (Fortune Global Top 25), Great Place To Work™ in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affimative Action employer. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Benefits/Perks

• Experian care for employee's work life balance, health, safety and wellbeing. In support of this endeavor, we offer best-in-class family well-being benefits, enhanced medical benefits and paid time off.

Recruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address.

Experian will never ask candidates to make any payment as part of an application, interview, assessment, onboarding, or recruitment process.

This is a hybrid remote/in-office role.

Experian Careers - Creating a better tomorrow together