Data Engineer III

Walmart Global Tech India; Chennai; On-site; INR 800,000 - 1,500,000; Full time

Benefits offered by this job

Incentive awards

Maternity and parental leave

PTO

Health benefits

Job summary

Walmart Global Tech India is looking for a data engineer to optimize market processes and build impactful data solutions. Candidates must hold a Bachelor's degree in Computer Science or a related field and possess 3+ years of experience. Proficiency in Big Data technologies like Hadoop and Spark, as well as cloud platforms such as AWS, Azure, or GCP, is essential. This role also emphasizes strong SQL and programming skills. Benefits include incentives, parental leave, and health benefits.

Qualifications

• 3+ years of experience in relevant field.
• Minimum 2 years in Big Data and distributed computing.
• Experience in building pipelines using Big Data stack.

Responsibilities

• Optimize processes for Walmart market and utilize resources efficiently.
• Partner with developers focusing on product quality.
• Build, test, and deploy data pipelines for business impact.

Skills

Big Data technologies (Hadoop, Spark, Hive)

AWS/Azure/GCP

SQL

Python

Java

Scala

Education

Bachelor’s degree in computer science or related discipline

Tools

Hadoop

Spark

Kafka

Airflow Scheduler

Job description

Responsibilities

• As a part of the Market Place team, work to optimize multiple Walmart market processes and ensure efficient utilization of resources.
• Partner with application developers to pursue efficiency and quality in the final product, focusing on security, performance, and functionality.
• Design, build, test, and deploy data pipelines and solutions at scale for multi‑billion‑dollar business impact.
• Develop and implement best‑in‑class data pipelines, data lake, and consumption/acceleration layers to meet capacity utilization goals and SLAs.
• Transform business requirements into code, analytical reports, and tools that provide actionable insights.
• Build and maintain infrastructure and platforms to maximize data‑driven impact, prioritizing projects and making sound judgments.
• Maintain and document data subject availability, accuracy, data lineage, and business/technical terminology.
• Provide business insights using internal tools, databases, and industry data; collaborate closely with product owners and technical leads on project delivery.
• Research and learn continuously, handling both new requests/projects and supporting production systems.

Qualifications

• Bachelor’s degree in computer science or related discipline with 3+ years’ experience.
• Minimum 2 years of experience in Big Data and distributed computing.
• Proven experience building pipelines on Big Data technologies/stack – Hadoop, Spark, Hive, DataProc, BigQuery, Kafka, and Airflow Scheduler.
• Deep understanding of the Hadoop ecosystem and solid conceptual knowledge of Hadoop architecture components; experience with at least one Big Data technology using Java, Python, or Scala.
• Strong knowledge of deploying and managing applications in AWS, Azure, or GCP.
• Strong scripting skills to process large amounts of data and high proficiency in SQL.

Preferred Skills

• Solid knowledge of Linux systems with ability to troubleshoot issues in complex, distributed, multi‑tier architectures.
• Experience with secure, scalable and highly available services.
• Experience with data science and machine learning.
• Build infrastructure for extraction, transformation, and loading of data from various sources using SQL and GCP big data technologies.
• Hands‑on experience with Python, Java, C++, Scala, and micro‑services frameworks.
• Strong written and verbal communication skills.

Benefits

Beyond the compensation package, you can receive incentive awards. Other perks include maternity and parental leave, PTO, health benefits, and more.

Equal Opportunity Employer

Walmart, Inc., is an Equal Opportunities Employer – By Choice. We focus on creating a workplace where everyone is respected and included.

Location

Primary Location: Tower 1, 1st–4th Floors, Intl Tech Park Radial Road (Radial It Park Pvt Ltd), India