Senior Data Engineering Lead

Experian; Hyderabad; Hybrid; INR 4,000,000 - 6,000,000; Full time

Job summary

Experian Hyderabad is seeking a senior engineering leader to define and deliver a modern, cloud-based data platform that powers analytics, AI, and business decision-making across the organization. You will lead the design and delivery of scalable batch and streaming data pipelines on AWS, establish data governance and reliability standards, and drive platform modernization.

You will mentor multidisciplinary teams, partner with product, governance, and business units, and ensure trusted, secure

Qualifications

• 10+ years of experience in Data Engineering, Software Engineering, or Platform Engineering, including leadership responsibility for engineering teams.
• Proven experience designing and operating large-scale batch and streaming data platforms using technologies such as Apache Spark, Kafka, Kinesis, Flink, or equivalent.
• Strong expertise in AWS cloud services, including data, compute, orchestration, and infrastructure components.
• Experience building modern data lake, warehouse, or lakehouse solutions using technologies such as Snowflake, Databricks, Redshift, Athena, Iceberg, Delta Lake, or similar platforms.
• Hands-on experience with CI/CD, Infrastructure as Code, containerized platforms, and engineering automation practices.
• Experience implementing data governance, observability, security, and compliance controls, including data quality frameworks and regulated data management.

Responsibilities

• Lead the design and delivery of scalable batch and streaming data platforms that support analytics, reporting, and AI use cases.
• Manage and mentor teams across Data Engineering, Platform Engineering, and DevOps while establishing engineering standards, reusable frameworks, and delivery roadmaps.
• Build reliable data pipelines with strong governance, observability, security, and data quality practices to ensure trusted data products.
• Drive cloud platform modernization using AWS services, infrastructure automation, CI/CD practices, and event-driven architectures.
• Partner with Product, Architecture, Governance, and Business teams to prioritize initiatives, manage delivery risks, and align platform investments with business goals.

Job description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries

Job Description

We are looking for a senior engineering leader to define and deliver a modern, cloud-based data platform that powers analytics, AI, and business decision-making across the organization.

This role is responsible for building scalable batch and real-time data pipelines, establishing data governance and reliability standards, and driving platform modernization on AWS.

The successful candidate will lead multidisciplinary engineering teams, shape the data platform strategy, and deliver secure, high-performing solutions that improve data accessibility, operational efficiency, and business outcomes while enabling future AI-driven capabilities

What You'll Be Doing

• This role is Hyderabad based and reporting to Director Engineering
• You will lead the design and delivery of scalable batch and streaming data platforms that support analytics, reporting, and AI use cases.
• Manage and mentor teams across Data Engineering, Platform Engineering, and DevOps while establishing engineering standards, reusable frameworks, and delivery roadmaps.
• You will build reliable data pipelines with strong governance, observability, security, and data quality practices to ensure trusted and compliant data products.
• Drive cloud platform modernization using AWS services, infrastructure automation, CI/CD practices, and event-driven architectures.
• Partner with Product, Architecture, Governance, and Business teams to prioritize initiatives, manage delivery risks, and align platform investments with business goals.

Qualifications

What We're Looking For

• 10+ years of experience in Data Engineering, Software Engineering, or Platform Engineering, including leadership responsibility for engineering teams.
• Proven experience designing and operating large-scale batch and streaming data platforms using technologies such as Apache Spark, Kafka, Kinesis, Flink, or equivalent.
• Strong expertise in AWS cloud services, including data, compute, orchestration, and infrastructure components.
• Experience building modern data lake, warehouse, or lakehouse solutions using technologies such as Snowflake, Databricks, Redshift, Athena, Iceberg, Delta Lake, or similar platforms.
• Hands-on experience with CI/CD, Infrastructure as Code, containerized platforms, and engineering automation practices.
• Experience implementing data governance, observability, security, and compliance controls, including data quality frameworks and regulated data management.

Additional Information

Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces 2025 (Fortune Global Top 25), Great Place To Work in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affi ...

Experian care for employee's work life balance, health, safety and wellbeing. In support of this endeavor, we offer best-in-class family well-being benefits, enhanced medical benefits and paid time off.

Recruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address.

Experian will never ask candidates to make any payment as part of an application, interview, assessment, onboarding, or recruitment process.

#LI-Onsite

This is a hybrid remote/in-office role.

Experian Careers - Creating a better tomorrow together

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply