Senior Data Engineer

Walmart; Sunnyvale (CA); On-site; USD 144,000 - 234,000; Full time

Benefits offered by this job

Health benefits

401(k) and stock purchase

Paid time off

Education assistance

Job summary

Walmart seeks a Senior Data Engineer in Sunnyvale to build scalable data pipelines and automated reporting solutions. You will translate business needs into analytical data models and own end-to-end delivery for BI and analytics initiatives.

You will design ETL processes, optimize SQL for large datasets, and collaborate with cross-functional teams to enable self-service analytics using Tableau/Looker. This role emphasizes modern cloud data platforms and data governance.

Qualifications

• Experience designing scalable data pipelines and ETL for analytics warehouses.
• Proficient in writing complex SQL, views, procedures, and UDFs for cloud databases (BigQuery).
• Experience with Hive, Spark, PySpark for data transformations.
• Familiar with cloud platforms (GCP preferred) and data pipeline tools like Airflow or Dataflow.

Responsibilities

• Designs and implements scalable data pipelines and automated reporting solutions.
• Translates business requirements into analytical data models and insights.
• Owns end-to-end delivery of data engineering tasks for BI and analytics.
• Builds and maintains ETL pipelines to transform raw data into analytics-ready datasets.
• Develops and optimizes SQL queries for reporting and dashboards.
• Documents data architecture, data flows, and transformation logic.
• Stays current with big data and cloud analytics trends.

Skills

Scalable data pipelines

SQL & ETL optimization

Python scripting

Cloud platforms (GCP/AWS/Azure)

Spark / PySpark

Data warehousing

Looker/Tableau BI

Education

Master's or Bachelor's in CS/IT/Engineering/Statistics

Tools

Hive

Spark

Airflow

Dataflow

Snowflake

Tableau/Looker

Job description

Senior Data Engineer

$144,402 - $234,000/yr Regular/ Permanent Salaried

Position: Senior Data Engineer

Job Location: 1375 Crossman Avenue, Sunnyvale, CA 94089

Duties

Designs and implements scalable data pipelines and automated reporting solutions to address business problems using analytics and big data technologies. Translates business requirements into analytical data models and actionable insights. Owns end-to-end delivery of data engineering tasks supporting business intelligence and self-service analytics initiatives. Builds and maintains ETL pipelines to transform raw data into analytics-ready datasets. Extracts, cleanses, and transforms structured and unstructured data using appropriate big data processing techniques such as Spark and Hive. Performs data exploration to identify trends, segmentation opportunities, funnel insights, and long-term business patterns. Develops and optimizes SQL queries to support reporting, dashboarding, and analytical use cases. Designs and maintains logical and physical data models for analytical data warehouses and data marts. Defines relational tables, primary and foreign keys, and transformation logic to support scalable reporting structures. Evaluates and enhances data models and data flows to improve accuracy, reliability, and performance. Identifies bottlenecks in data processing pipelines and implements automation and optimization solutions to improve query performance and reporting efficiency. Performs data quality validation checks to ensure integrity and reliability of metrics. Develops reusable scripts and tools using Python and SQL to streamline data processing and reporting workflows. Partners with cross-functional stakeholders to enable self-service BI through structured datasets and dashboard-ready tables. Builds proof-of-concepts to evaluate emerging big data and data visualization technologies. Documents data architecture, data flows, and transformation logic to support analytics scalability and governance best practices. Stays current with big data, cloud analytics, and data visualization technology trends and makes recommendations based on business needs.

Minimum education and experience required

Master's degree or the equivalent in Computer Science, Information Technology, Engineering (any), Statistical Science, or a related field plus 1 year of experience in software engineering or related experience; OR Bachelor's degree or the equivalent in Computer Science, Information Technology, Engineering (any), Statistical Science, or a related field plus 3 years of experience in software engineering or related experience.

Skills required

Must have experience with: Designing and building scalable data pipelines and ETL workflows to support analytical data warehouses; Developing complex SQL queries, views, stored procedures, and user-defined functions in cloud databases including Google BigQuery; Optimizing long-running queries and improving performance of large-scale analytical datasets; Parsing, cleansing, and transforming structured and unstructured data using Hive, Spark, and PySpark; Developing automation scripts and reusable tools using Python; Designing and implementing data models to support reporting, dashboarding, and self-service BI; Working with cloud platforms, including Google Cloud Platform (preferred), AWS, Azure, and Snowflake at scale; Leveraging cloud data pipeline orchestration tools: Airflow, Dataflow; Building analytical datasets to support Tableau and Looker; Performing data exploration and statistical analysis to uncover business insights and common data pitfalls; Identifying data bottlenecks and implementing optimization strategies to enhance pipeline efficiency and data reliability; Producing technical documentation including data architecture diagrams, source-to-target mappings, and ETL workflow designs. Employer will accept any amount of experience with the required skills.

Salary Range

$144,402/year to $234,000/year. Additional compensation includes annual or quarterly performance incentives.

Benefits

• At Walmart, we offer competitive pay as well as performance-based incentive awards and other great benefits for a happier mind, body, and wallet.
• Health benefits include medical, vision and dental coverage.
• Financial benefits include 401(k), stock purchase and company-paid life insurance.
• Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty and voting.
• Other benefits include short-term and long-term disability, education assistance with 100% company paid college degrees, company discounts, military service pay, adoption expense reimbursement, and more.

Eligibility and Benefits Terms

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. For information about benefits and eligibility, see One.Walmart.com.

Equal Opportunity Employer

Wal-Mart is an Equal Opportunity Employer.

Drug-free Workplace Policy

Walmart and its subsidiaries are committed to maintaining a drug-free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment. Walmart is committed to maintaining a drug-free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.

Benefits you'll enjoy

• Discount CardGet 10% off
• Walmart associates are eligible for a 10% discount card on most regular-priced items and fresh produce in-store and on select items at Walmart.com. Eligible after 90 days of employment.
• Live Better U100% coveredEarn a degree or in-demand skills certificates with no debt- Walmart covers 100% of tuition and books. Live Better U offers 60+ programs for Associates to pursue their dreams.
• Walmart AcademyGrow your skillsReady to grow your career? Walmart Academy offers job-specific retail training and leadership courses to help Associates reach their career goals.
• Financial perksEnjoy 401(k) matching and stock purchase plans.
• Paid time offTake a break as needed for vacation, sick leave, holidays, parental leave, and more
• Comprehensive health benefitsMedical, dental, vision, and wellness programs for you and your family
• Wellbeing programsAccess mental health resources and assistance programs for life's challenges
• Career growth opportunitiesTraining, leadership programs, and clear paths to advance.
• Learn more Life at WalmartImagine a workplace surrounded by innovation. At Walmart's new Home Office in Bentonville, Arkansas, we're redefining what it means to work at a global leader.Set on 350 acres of thoughtfully revitalized land, our new campus seamlessly integrates the charm of Northwest Arkansas with cutting edge design and technology. From biking trails and outdoor courtyards to flexible, tech-enabled workspaces, every detail reflects our commitment to sustainability, connection, and culture.With amenities like on-site childcare at our Little Squiggles Children's Enrichment Center, the Walton Family Whole Health & Fitness Center, and a vibrant food hall featuring local and international favorites, we're creating a space where work-life balance isn't just a goal-it's a reality. Beyond the campus, Bentonville offers a dynamic lifestyle with world-class dining, art at the Crystal Bridges Museum, and countless outdoor activities.Whether you're exploring High South cuisine, enjoying live performances at our new amphitheater, or cycling the Razorback Greenway, you'll experience the perfect blend of small-town charm and big-city amenities. Join us at Walmart and grow your career alongside a community that feels like home.This isn't just a workplace-it's a destination for leaders eager to make a difference.