Staff, Data Engineer

Walmart Global Tech India; Chennai District; Hybrid; INR 3,500,000 - 5,500,000; Full time

Benefits offered by this job

Maternity leave

Parental leave

Health benefits

PTO

Job summary

Walmart Global Tech India seeks a Staff Data Engineer to help build next-generation data infrastructure, including batch and streaming pipelines at Walmart scale. You will own data quality and observability, drive platform services, APIs, and distributed systems, and collaborate with data scientists on feature pipelines.

You will apply domain-oriented design, LL/DDD, and platform engineering practices while leveraging AI/GenAI capabilities to enhance data quality, governance, and lineage.

Qualifications

• Hands-on software engineering with data at scale, including Spark and Python/Java.
• Experience with big data ecosystem and data governance is expected.
• Strong ownership mindset and ability to operate autonomously in early-stage teams.

Responsibilities

• Design, build, and operate large-scale batch and streaming pipelines.
• Apply software engineering fundamentals to data-centric systems.
• Develop platform services, APIs, and distributed components for data pipelines.
• Integrate AI/GenAI capabilities into data platforms and MLOps paths.
• Collaborate with data scientists and ML engineers on feature pipelines.
• Own data quality, observability, and governance for pipelines and datasets.

Skills

Java

Python

Spark

Go

C++

Scala

OE/EE mindset

Distributed systems

DDD/LLD

Kubernetes

CI/CD

Cloud-native

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Tools

Hadoop/HDFS

Hive

Kafka

Airflow

Delta Lake

Databricks

Job description

About Team

GDF (Global Data Foundation) is part of Walmart's AI & Data organization - the team building the foundational data platforms that power AI, analytics, and decision-making across every Walmart banner and geography, from supply chain and merchandising to customer experience and enterprise AI agents. Our newly created platform team is chartered with building next-generation data infrastructure at Walmart scale: reliable, high-throughput data pipelines, distributed processing systems, and platform capabilities that downstream teams across Walmart depend on every day.

What You'll Do

• Design, build, and operate large-scale batch and streaming data pipelines using Spark, Java, and Python, processing data at Walmart scale.
• Apply strong software engineering fundamentals - clean architecture, automated testing, CI/CD, code review discipline - to data engineering work; this is a software engineering role that specializes in data, not a script-writing role.
• Apply domain-oriented design, system design, and low-level design (LLD) rigor to ambiguous data and platform problems - evaluating dependencies, trade-offs, failure modes, scalability, cost, and long-term durability before writing a line of code.
• Flex into platform/software engineering work when needed: build and maintain services, APIs, and distributed systems that data pipelines depend on, contributing directly to GDF's broader platform codebase.
• Integrate AI, GenAI, and agentic capabilities directly into the data platform: embeddings/vector search for data discovery, LLM-assisted data quality and anomaly detection, agentic pipeline monitoring and self-healing, AI-assisted schema and lineage documentation.
• Partner with data scientists and ML engineers to build feature pipelines, model-serving data paths, and the data infrastructure that MLOps depends on.
• Own data quality, observability, and governance for the pipelines and datasets you build, with a strong Operational Excellence / Engineering Excellence discipline.
• Participate in and lead architecture and design reviews spanning both data engineering and platform engineering domains.
• As a Staff engineer, set technical direction and best practices within your team and technical domain without needing a management title - mentor other engineers and influence GDF's broader data engineering standards.
• Continuously evaluate emerging Big Data, cloud, and AI/agentic technologies, adopting them pragmatically where they improve reliability, productivity, or business value.

What You'll Bring

• Genuinely hands-on coding: 8+ years of professional software engineering experience with significant hands-on data engineering at scale; strong proficiency in Java and Python is required, and strong working knowledge of Spark for distributed data processing is required, not optional. Additional experience with Go, C++, or Scala is a plus.
• Operational Excellence (OE) and Engineering Excellence (EE) mindset is a required skill, not a nice-to-have: SLO/SLA ownership, incident management and blameless post-incident reviews, proactive reliability and quality metrics, and continuous improvement built into how you ship, not bolted on afterward.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
• Deep experience with the Big Data ecosystem - Spark, Hadoop/HDFS, Hive, Kafka, workflow orchestration (Airflow or equivalent) - including batch and streaming processing, and large-scale data transformation.
• Strong data platform fundamentals: data modeling, ETL/ELT pipeline design, data quality and observability, data governance, and integration with lakehouse architectures (e.g., Delta Lake, BigQuery, Databricks).
• Full exposure to AI and Agentic technologies: hands-on experience integrating model APIs and GenAI/LLM tooling, building or operating agentic workflows (tool-calling agents, multi-step autonomous systems), working with embeddings/vector search, and applying MLOps practices (feature stores, model lifecycle, retraining pipelines) - not just conceptual awareness.
• Working literacy in platform engineering: microservices, API design, Kubernetes or equivalent orchestration, CI/CD, and cloud-native practices - enough to flex into platform/software engineering work confidently.
• Strong distributed systems fundamentals: event-driven patterns, service contracts, asynchronous processing, and fault tolerance at scale - paired with strong system design, domain-oriented design (DDD), and low-level design (LLD) skills, and demonstrated ability to evaluate trade-offs, failure modes, scalability, and cost when owning production code.
• Strong software engineering craftsmanship: testing strategy, code review standards, design patterns, and system design for high-throughput data systems.
• Proven ability to translate ambiguous data/business problems into clear technical execution plans, particularly within a newly formed team without fully established process.
• Strong ownership mindset and technical judgment; comfortable operating with high autonomy in a 0-to-1 environment.

About Walmart Global Tech

Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That's what we do at Walmart Global Tech. We're a team of software engineers, data scientists, cybersecurity experts, and service professionals within the world's leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered.

Benefits

Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits - maternity and parental leave, PTO, health benefits, and much more. Walmart's culture sets us apart, and we know being together helps us innovate, learn, and grow great careers. This role is based in our [Bangalore/Chennai] office for daily work, with the flexibility for associates to manage their personal lives.

Belonging

We aim to create a culture where every associate feels valued for who they are, rooted in respect for the individual. Our goal is to foster a sense of belonging, to create opportunities for all our associates, customers and suppliers, and to be a Walmart for everyone. At Walmart, our vision is "everyone included." By fostering a workplace culture where everyone is - and feels - included, everyone wins.

Equal Opportunity Employer

Walmart, Inc., is an Equal Opportunities Employer - By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing unique styles, experiences, identities, ideas and opinions while being inclusive of all people.

Minimum Qualifications

Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.

Minimum Qualifications:Option 1: Bachelor's degree in Computer Science and 4 years' experience in software engineering or related field. Option 2: 6 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science and 2 years' experience in software engineering or related field. 3 years' experience in data engineering, database engineering, business intelligence, or business analytics.

Preferred Qualifications

Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.

Primary Location

Tower 1, Part Of 1st, 2nd To 4th Flrs, Intl Tech Park Radial Road (radial It Park Pvt Ltd), , India