Senior Data Engineering Lead

Experian Group; Hyderabad; Hybrid; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Best medical benefits

Family well-being benefits

Paid time off

Hybrid work model

Job summary

Experian is seeking a senior engineering leader in Hyderabad to define and deliver a modern cloud-based data platform powering analytics, AI, and decision-making. You will drive scalable batch and real-time pipelines, strong governance, and platform modernization on AWS, leading multidisciplinary teams to deliver secure, high-performing data products.

You will align with Product, Architecture, and Governance teams to prioritise initiatives, establish engineering standards, and enable future AI

Qualifications

• 10+ years in Data/Software/Platform engineering with leadership responsibility.
• Experience operating large-scale batch and streaming platforms with Spark/Kafka/Kinesis.
• Strong AWS cloud services expertise for data/compute/orchestration components.
• Experience building data lake/warehouse/lakehouse solutions (Snowflake/Databricks/Redshift/Athena).
• Hands-on with CI/CD, IaC, containerized platforms, and automation.
• Experience implementing data governance, observability, security, and compliance controls.

Responsibilities

• Lead the design and delivery of scalable batch and streaming data platforms.
• Manage and mentor Data/Platform/DevOps teams and set engineering standards.
• Build reliable data pipelines with governance, observability, and data quality.
• Drive cloud modernization using AWS, automation, CI/CD, and event-driven architectures.
• Partner with Product, Architecture, Governance, and Business teams to align investments.

Skills

Leadership

Data Platform design

Cloud architecture

Engineering excellence

Tools

Apache Spark

Kafka

Kinesis

Flink

Snowflake

Databricks

Redshift

Athena

Iceberg

Delta Lake

CI/CD

Infrastructure as Code

Containerization

Job description

Role Overview

We are looking for a senior engineering leader to define and deliver a modern, cloud-based data platform that powers analytics, AI, and business decision-making across the organization.

This role is responsible for building scalable batch and real-time data pipelines, establishing data governance and reliability standards, and driving platform modernization on AWS.

The successful candidate will lead multidisciplinary engineering teams, shape the data platform strategy, and deliver secure, high-performing solutions that improve data accessibility, operational efficiency, and business outcomes while enabling future AI-driven capabilities

What You'll Be Doing

• This role is Hyderabad based and reporting to Director Engineering
• You will lead the design and delivery of scalable batch and streaming data platforms that support analytics, reporting, and AI use cases.
• Manage and mentor teams across Data Engineering, Platform Engineering, and DevOps while establishing engineering standards, reusable frameworks, and delivery roadmaps.
• You will build reliable data pipelines with strong governance, observability, security, and data quality practices to ensure trusted and compliant data products.
• Drive cloud platform modernization using AWS services, infrastructure automation, CI/CD practices, and event-driven architectures.
• Partner with Product, Architecture, Governance, and Business teams to prioritize initiatives, manage delivery risks, and align platform investments with business goals.

Experience and Skills

What We're Looking For

• 10+ years of experience in Data Engineering, Software Engineering, or Platform Engineering, including leadership responsibility for engineering teams.
• Proven experience designing and operating large-scale batch and streaming data platforms using technologies such as Apache Spark, Kafka, Kinesis, Flink, or equivalent.
• Strong expertise in AWS cloud services, including data, compute, orchestration, and infrastructure components.
• Experience building modern data lake, warehouse, or lakehouse solutions using technologies such as Snowflake, Databricks, Redshift, Athena, Iceberg, Delta Lake, or similar platforms.
• Hands-on experience with CI/CD, Infrastructure as Code, containerized platforms, and engineering automation practices.
• Experience implementing data governance, observability, security, and compliance controls, including data quality frameworks and regulated data management.

About Experian

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries

Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces™ 2025 (Fortune Global Top 25), Great Place To Work™ in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affinesive Action employer. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Benefits/Perks

Experian care for employee's work life balance, health, safety and wellbeing. In support of this endeavor, we offer best-in-class family well-being benefits, enhanced medical benefits and paid time off.

Recruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address.

This is a hybrid remote/in-office role.

Experian Careers - Creating a better tomorrow together