Data Engineer III

Walmart Global Tech India; Chennai District; On-site; INR 1,000,000 - 1,500,000; Full time

Benefits offered by this job

Maternity and parental leave

Health benefits

PTO

Job summary

Walmart Global Tech India in Chennai is looking for a Data Engineer 3 to optimize processes and ensure efficient data utilization. As part of the Market Place team, you'll design, build, and maintain data pipelines, focusing on Big Data technologies like Hadoop and Spark.

Successful candidates will have a Bachelor's degree in computer science and at least 3 years' experience in software engineering. Excellent problem-solving skills and the ability to automate processes are crucial.

Qualifications

• 3+ years’ experience in software engineering or related field.
• Minimum 2 years of experience in Big Data and distributed computing.
• Strong knowledge of deploying applications in AWS or Azure or GCP.

Responsibilities

• Design and build data pipelines to analyze huge datasets.
• Develop and implement Data pipeline and Data lake.
• Create automation for data processes.

Skills

Big Data Technologies

Java

Python

SQL

Scala

Education

Bachelor's degree in computer science or related discipline

Tools

Hadoop

Spark

Hive

Airflow

Job description

About the Team

Global Data Organization @ Walmart Global Tech in Chennai provides support for Global Data, Data Foundation Infrastructure, Visualization Portal, Machine Learning Platform, Customer platform and Data Science products that form part of core platforms and services that drive Walmart business. The group also develops analytical products for several verticals like merchandising, supply chain, pricing, customer, HR etc. Our team which is part of Global Data Chennai is responsible for creating and supporting the next generation Data Platform which comprises of building a central data lake, regional data lake for compliance reasons, frameworks that support data ingestion in batch and real time manner, data processing, data quality and governance implementation and surfacing this data & metadata to users. The team plays an important role to make Walmart data driven, by enabling all domain teams to use the platform and frameworks. User experience is key for the success for this team.

What You’ll Do

We are looking for a Data Engineer 3 to join the Market Place team at Walmart Global Tech. The team at Chennai has an open fun culture where each idea is challenged as well as respected. If you are a software geek who loves to solve complex problems and is interested to learn new things daily, Walmart Global Tech is the place for you.

As part of the Market Place team, you will have a significant impact on Walmart’s business. You’ll play a crucial role in optimising the Market Place processes and ensure efficient utilisation. The Data Engineer 3 works in partnership with the application developers to pursue efficiency and quality in the final product. This individual has a strong quality assurance mentality and is experienced in design, development and testing of Data Lake and ETL pipelines. They meet the acceptance criteria of the stakeholders in security, performance, functionality or all of the above. Ability to create automation is a plus.

Responsibilities include designing and building data pipelines to analyze huge datasets, creating powerful visualisations to derive insights, partnering with the product team to brainstorm and act on opportunities, building and maintaining infrastructure and platform to maximize data driven impact. The role demands accurate prioritisation of projects, sound judgments, process improvements and effective execution.

As a Data Engineer 3 you will own and build scalable and highly available distributed systems in production and have the following responsibilities:

• Develop and implement best‑in‑class Data pipeline and Data lake, Consumption/Acceleration layers to ensure best capacity utilisation and meet SLAs.
• Demonstrate and transform business requirements to code, specific analytical reports and tools.
• Design, build, test and deploy cutting‑edge solutions at scale, impacting multi‑billion‑dollar business.
• Work closely with product owner and technical lead and play a major role in the overall delivery of the assigned project/enhancements.
• Learn & research on the go and work on both new requests/projects as well as support production.
• Provide business insights while leveraging internal tools and systems, databases and industry data.
• Own a data subject and ensure availability and accuracy.
• Document requirements, data lineage, subject matter in both business and technical terminology.

What You’ll Bring

Minimum qualifications: Bachelor’s degree in computer science or related discipline with 3+ years’ experience.

Minimum 2 years of experience in Big Data and distributed computing.

• Proven experience building pipelines on Big Data Technologies/Stack – Hadoop, Spark, Hive, DataProc, BigQuery, Kafka and Airflow Scheduler to name a few.
• Deep understanding of the Hadoop ecosystem and strong conceptual knowledge in Hadoop architecture components and experience in working on at least one Big Data technology with Java, Python or Scala.
• Strong knowledge of deploying and managing applications in AWS or Azure or GCP.
• Strong scripting skills to process large amount of data and highly proficient in SQL.

Preferred Skills Below

• Solid knowledge of Linux systems with the ability to troubleshoot issues in complex, distributed, multi-tier architectures.
• Experience in secure, scalable and highly available services.
• Experience with data science and machine learning is a plus.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and GCP ‘bigdata’ technologies.
• Excellent hands‑on working knowledge and experience with object‑oriented/object function scripting languages: Python, Java, C++, Scala.
• Good to have experience Micro‑services frameworks.
• Good written and verbal communication skills.

About Walmart Global Tech

Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity experts and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people‑led and tech‑empowered.

We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.

Benefits

Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best‑in‑class benefits maternity and parental leave, PTO, health benefits, and much more.

Belonging

We aim to create a culture where every associate feels valued for who they are, rooted in respect for the individual. Our goal is to foster a sense of belonging, to create opportunities for all our associates, customers and suppliers, and to be a Walmart for everyone. At Walmart, our vision is “everyone included.” By fostering a workplace culture where everyone is—and feels—included, everyone wins. Our associates and customers reflect the makeup of all 19 countries where we operate. By making Walmart a welcoming place where all people feel like they belong, we’re able to engage associates, strengthen our business, improve our ability to serve customers, and support the communities where we operate.

Equal Opportunity Employer

Walmart, Inc., is an Equal Opportunities Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.

Minimum Qualifications

Option 1: Bachelor's degree in Computer Science and 2 years' experience in software engineering or related field. Option 2: 4 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science.

Location

Primary Location: Tower 1, Part Of 1st, 2nd To 4th Flrs, Intl Tech Park Radial Road (radial It Park Pvt Ltd), , India