PRINCIPAL, DATA ENGINEER

Walmart Global Tech India

Bengaluru

Vor Ort

INR 2.800.000 - 6.000.000

Vollzeit

Vor 7 Tagen
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Maternity and parental leave
Paid time off (PTO)
Health benefits

Zusammenfassung

Walmart Global Tech India is seeking a senior data engineer to design, build, and deploy cutting-edge data solutions at scale, handling terabytes to petabytes of data. You will develop high-performance Spark pipelines, ensure data quality, and collaborate with cross-geo teams to deliver impactful analytics features.

This role is based in Bengaluru with daily on-site expectations. Experience with cloud platforms (AWS, GCP, Azure), CI/CD, and data security practices is valued as you mentor juniors

Qualifikationen

  • Bachelor's or master's degree in computer science or related field.
  • 12 years of hands-on object-oriented programming experience in Python.
  • 8+ years in Database Fundamentals, SQL, PLSQL, Store Procedures.
  • 7+ years designing and developing large-scale data pipelines using Spark, Kafka, Cassandra, Hadoop, Hive, Presto, Airflow.

Aufgaben

  • Design, build, test, and deploy data solutions at Walmart scale.
  • Develop high-performance Spark and Big Data pipelines for large datasets.
  • Perform root cause analysis to answer business questions and identify improvements.
  • Build and optimize data pipelines handling terabytes and petabytes of data.
  • Collaborate with global Walmart teams to leverage expertise and contribute to the tech community.
  • Mentor junior resources and drive best practices across teams.

Kenntnisse

Python
Scala
Spark
Kafka
Azure
GCP
Airflow

Ausbildung

Bachelor's degree in Computer Science
Master's degree in Computer Science

Tools

Apache Spark
Kafka
Cassandra
Hadoop
Hive
Presto
Airflow

Jobbeschreibung

Skillset: Python or Scala, Spark, Kafka, Azure, GCP, AirflowExperience range: 12 - 16 years

About Team

Walmart’s Corporate Tech and Services is a powerhouse of several exceptional teams delivering world-class technology solutions and services making a profound impact at every level of Walmart.

As a key part of Walmart Global Tech, our teams set the bar for operational excellence makes a purchase, a new supplier is onboarded, the company closes the books, physical and legal risk is avoided, and when we pay our associates consistently and accurately, that is Corporate Tech. Joining this team means embarking on a journey of and leverage emerging technology to support millions of customers, associates, and stakeholders worldwide. Each time an associate turns on their laptop, a customer limitless growth, relentless innovation, and the chance to set new industry standards that shape the future of Walmart.

What You'll Do
  • Design, build, test, and deploy cutting‑edge data solutions at Walmart scale, impacting millions of customers worldwide.
  • Develop high‑performance, scalable Spark and Big Data solutions to extract, transform, and load large‑scale datasets.
  • Perform root cause analysis on data and processes to answer business questions and identify improvement opportunities.
  • Build and optimize data pipelines, architectures, and datasets handling terabytes and petabytes of data.
  • Collaborate with Walmart engineering teams across geographies to leverage expertise and contribute to the technology community.
  • Partner with Product Management and business teams to drive priorities and deliver innovative product features.
  • Work closely with Data Engineers to evaluate and implement open‑source tools through research, POCs, and pilot programs.
  • Support business and product teams by building data solutions and developing deep expertise in data analytics.
  • Collaborate with team members to define best practices and meet client requirements for software development.
  • Analyze and test programs and products before launch to ensure high‑quality performance.
  • Develop solutions and monitoring mechanisms to ensure software security and protect sensitive information.
  • Continuously identify opportunities to enhance software performance, scalability, and effectiveness.
  • Mentor, coach, and support team members to strengthen their confidence and proficiency in software applications.
  • Contribute to a culture of innovation, collaboration, and continuous improvement across the engineering organization
What You'll Bring
  • Bachelor's or master's degree in computer science or a related technical field.
  • 12 years of hands‑on object‑oriented programming experience in Python.
  • 8+ years of hands‑on in Database Fundamentals, SQL, PLSQL, Store Procedures.
  • 7+ years of experience in designing and developing large‑scale, fault‑tolerant, highly scalable data pipelines using big data technologies (e.g., Apache Spark, Kafka, Cassandra, Hadoop, Hive, Presto, Airflow).
  • Strong understanding & experience in system design, algorithms, distributed systems, and high‑scale data processing.
  • Deep understanding of ETL, Data Modeling & Data Warehousing concepts.
  • Strong programming expertise to understand requirements, design high‑level & low‑level solutions (HLD/LLD), and implement design patterns with S.O.L.I.D principles.
  • Experience in end‑to‑end product development, emphasizing configuration‑driven, behavior‑driven, and test‑driven development (including unit test cases and DevOps best practices).
  • Designing systems that gracefully handle failures, high concurrency, data inconsistencies, and edge cases.
  • Ensuring zero data loss and 100% accuracy in data pipelines, even under high‑volume traffic.
  • Implementing and tuning systems that process petabytes of data with sub‑second latency.

Experience in mentoring junior resources

Platform driven approach.

  • Implementing fine‑grained access controls, encryption, and data masking techniques.
  • Implementing real‑time monitoring, logging, tracing, and alerting to ensure high availability and proactive issue resolution.
  • Writing robust integration, regression, and performance test cases to detect defects early.
  • Experience with Jenkins, GitHub Actions, or GitLab CI/CD to streamline release management.
  • Ability to prioritize and make trade‑offs between performance, cost, and reliability.
  • Expertise in failure analysis, RCA (Root Cause Analysis), and rollback strategies.
  • Additional Qualifications:
  • Experience in building large‑scale distributed systems, ensuring scalability and fault tolerance.
  • Strong exposure to cloud infrastructure (AWS, GCP, OpenStack, etc.).
  • Experience working with metadata‑driven development approaches.
  • Passion for automation, optimization, and improving system efficiency.
  • Strong problem‑solving, critical thinking, and analytical skills.
  • Excellent communication skills, with the ability to explain complex technical concepts effectively.
About Walmart Global Tech

Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity expert’s and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people‑led and tech‑empowered.

We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.

Walmart’s culture sets us apart, and we know being together helps us innovate, learn and grow great careers. This role is based in our [Bangalore/Chennai] office for daily work, with the flexibility for associates to manage their personal lives.

Benefits

Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best‑in‑class benefits maternity and parental leave, PTO, health benefits, and much more.

Belonging

We aim to create a culture where every associate feels valued for who they are, rooted in respect for the individual. Our goal is to foster a sense of belonging, to create opportunities for all our associates, customers and suppliers, and to be a Walmart for everyone.

At Walmart, our vision is "everyone included." By fostering a workplace culture where everyone is—and feels—included, everyone wins. Our associates and customers reflect the makeup of all 19 countries where we operate. By making Walmart a welcoming place where all people feel like they belong, we’re able to engage associates, strengthen our business, improve our ability to serve customers, and support the communities where we operate.

Equal Opportunity Employer

Walmart, Inc., is an Equal Opportunities Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing unique styles, experiences, identities, ideas and opinions – while being inclusive of all people

Minimum Qualifications

Minimum Qualifications:Option 1: Bachelor's degree in Computer Science and 5 years' experience in software engineering or related field. Option 2: 7 years' experience in software engineering or related field. Option 3: Master's degree in Computer Science and 3 years' experience in software engineering or related field. 4 years' experience in data engineering, database engineering, business intelligence, or business analytics.

Preferred Qualifications

Preferred Qualifications...Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.

Primary Location

Block- 1, Prestige Tech Pacific Park, Kadubeesanahalli Village, Varthur Hobli , India

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior, Data Engineer
Senior, Data Engineer

Walmart • Indien

Remote
INR 450.000 - 700.000
Maternity and parental leave
PTO
Health benefits
(IND) STAFF, DATA ENGINEER
(IND) STAFF, DATA ENGINEER

Walmart Global Tech India • Bengaluru

Vor Ort
INR 3.500.000 - 5.500.000
PRINCIPAL, DATA ENGINEER
PRINCIPAL, DATA ENGINEER

TigerHire • Bengaluru

Hybrid
INR 4.000.000 - 7.000.000
Senior, Data Engineer
Senior, Data Engineer

Walmart Global Tech India • Chennai District

Vor Ort
INR 3.500.000 - 5.500.000
STAFF, SOFTWARE ENGINEER (Fullstack)
STAFF, SOFTWARE ENGINEER (Fullstack)

Walmart Global Tech India • Bengaluru

Vor Ort
INR 2.800.000 - 5.200.000
Incentive awards
Maternity and parental leave
PTO
+1
Senior, Data Engineer
Senior, Data Engineer

Walmart Global Tech India • Chennai

Hybrid
INR 900.000 - 1.600.000
Health benefits
Maternity and parental leave
PTO
Software Engineer III (BigData)
Software Engineer III (BigData)

Walmart • Bengaluru

Vor Ort
INR 2.600.000 - 5.000.000
(IDC) STAFF, SOFTWARE ENGINEER
(IDC) STAFF, SOFTWARE ENGINEER

Walmart Global Tech India • Bengaluru

Vor Ort
INR 4.000.000 - 7.000.000
Incentive awards
Maternity and parental leave
PTO
+1
STAFF, SOFTWARE ENGINEER - Full Stack
STAFF, SOFTWARE ENGINEER - Full Stack

Walmart Global Tech India • Bengaluru

Vor Ort
INR 4.000.000 - 7.000.000
Health benefits
Paid time off
Maternity and parental leave
Staff, Software Engineer - BE
Staff, Software Engineer - BE

Walmart Global Tech India • Chennai District

Vor Ort
INR 2.000.000 - 3.500.000
Incentive awards
Maternity & parental leave
Health benefits
+2