(IND) SENIOR MANAGER, DATA ENGINEERING

Walmart Global Tech India; Chennai; On-site; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

Incentive awards

Maternity and parental leave

Health benefits

Paid time off

Job summary

Walmart Global Tech India is seeking a Lead Data Engineer to oversee a team creating and managing the People Data Lake. This role requires 12+ years of experience in software or data engineering, with a focus on cloud technologies like GCP and tools like Spark and BigQuery. The ideal candidate will drive architectural solutions and best practices while ensuring data security. The position is located in Chennai, India, and offers a comprehensive benefits package including health benefits, paid time off, and parental leave.

Qualifications

• 12+ years of experience in software or data engineering with 3+ years leading teams.
• Strong hands-on expertise in Spark, BigQuery, and Airflow.
• Proven experience with large-scale data lakes or lakehouse platforms.

Responsibilities

• Lead and grow a team of 8-10 data engineers.
• Own the architecture and delivery of data pipelines.
• Drive best practices for data modeling and pipeline reliability.

Skills

Spark

BigQuery

Airflow

SQL

Data modeling

Distributed systems

Data security principles

AI/ML integration

Education

Bachelor's degree in Computer Science

Master's degree (optional)

Tools

GCP

Kafka

Flink

Job description

Overview

People Data Platform – Powering Secure, Enterprise-Scale People Insights at Walmart. The People Data Platform team at Walmart owns the centralized People Data Lake that enables trusted, cross-domain people insights across the enterprise. We build and operate a scalable data platform on GCP, ingesting data from multiple source systems and transforming it through a robust medallion architecture to deliver high-quality, analytics-ready data.

Our team designs data and semantic models that empower HR, business, and analytics teams to make data-driven decisions at scale. In parallel, we lead the Data Security charter for the People Data Lake, implementing encryption, masking, and fine-grained access controls to protect sensitive data while ensuring compliant and governed access.

The Workforce Intelligence Platform (WIP) builds the access and experience layer on top of this foundation, enabling secure, personalized, and scalable analytics consumption. WIP combines query execution, dynamic access control, and API-driven architecture to power dashboards, applications, and AI-driven data interactions.

Operating at the intersection of big data, cloud, security, and platform engineering, we are building a future-ready analytics platform that supports one of the world’s largest workforces.

Responsibilities

• Lead and grow a high-performing team of 8-10 data engineers building and operating the People Data Lake.
• Own the architecture, design, and delivery of scalable batch and future streaming data pipelines using Spark, Big Query, Airflow, and related cloud-native technologies.
• Drive best practices across data modeling, pipeline reliability, observability, and cost optimization to ensure high performance and availability.
• Define and implement the data security framework for the lake, including encryption (at rest and in transit), masking and fine-grained access controls.
• Establish secure data sharing and governance mechanisms to protect sensitive data and ensure regulatory and enterprise compliance.
• Partner with Product, HR, Analytics, Security, and Architecture teams to define roadmap, prioritize initiatives, and deliver scalable, resilient, and secure data solutions.
• Build a strong engineering culture focused on operational excellence, technical rigor, and continuous improvement while shaping the mid- to long-term platform vision.
• Establish best engineering and operational excellence practices based on product, engineering, and scrum metrics.
• Work with senior leadership to chart out the future roadmap of the products.
• Participate in hiring, mentoring, and building high performing agile teams.
• Establish clear expectations with individuals based on their level and role, meeting regularly to discuss performance, provide feedback and coaching.

Qualifications

• 12+ years of experience in software or data engineering with 3+ years leading high-performing engineering teams.
• Strong hands‑on expertise in Spark, BigQuery, Airflow (or equivalent), and distributed data systems on GCP.
• Experience with big data and distributed systems such as Spark and Flink.
• Proven experience designing, building, and operating large‑scale data lakes or lakehouse platforms with batch and streaming ingestion.
• Deep understanding of data security principles including encryption, PII protection, masking, IAM, and row/column-level security.
• Strong SQL and data modeling skills with experience implementing CI/CD, monitoring, and reliability best practices for data platforms.
• Ability to operate at both strategic and execution levels, influence cross‑functional stakeholders, and translate platform vision into secure, scalable business outcomes.
• Knowledge of Pub/Sub systems such as Kafka.
• Knowledge of cloud platforms such as Azure, GCP, or others.
• Lead the integration of AI/ML toolkits and frameworks into day‑to‑day data engineering workflows, enabling teams to accelerate development, automate data processes, and enhance decision-making capabilities.
• Minimum qualifications: Bachelor's degree in Computer Science and 5 years’ experience in software engineering or related field; 7 years’ experience in software engineering; Master's degree and 3 years of experience; 4 years of experience in data engineering, database engineering, business intelligence, or analytics; 1 year supervisory experience.

Benefits

Beyond our great compensation package, you can receive incentive awards for your performance. Other perks include maternity and parental leave, paid time off, health benefits, and much more.

Location

Primary Location: Tower 1, Part Of 1st, 2nd To 4th Flrs, Intl Tech Park Radial Road (radial It Park Pvt Ltd), India.

Equal Opportunity Employer

Walmart, Inc. is an Equal Opportunity Employer By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting, and valuing unique styles, experiences, identities, ideas and opinions while being welcoming of all people.