Senior Data Engineer: Build Scalable Pipelines & Lakehouse

Walmart; Denver (CO); On-site; USD 99,000 - 198,000; Full time

Benefits offered by this job

Discount Card

Live Better U covered

Walmart Academy training

Medical, dental, vision

PTO and family benefits

Job summary

Walmart seeks a Senior Data Engineer to design and maintain scalable data pipelines and architectures supporting analytics and ML initiatives. You will work across teams to translate requirements into data solutions, ensure data quality, and enable access for data scientists and apps.

You will leverage SQL, Python, Spark, Airflow, and cloud services (AWS/GCP) while handling large-scale data lakes and Delta Lake architecture.

Qualifications

• Extensive experience in data engineering, including data integration, modeling, and pipeline development including designing and implementing ETL processes.
• High Proficiency in Pyspark, SparkSQL and/or Scala.
• Proficiency in SQL and programming languages such as Python or Java for code development and testing.
• Extensive knowledge of AWS/GCP Cloud Services.
• 5+ years of experience within Data Engineering and prior experience working with Big Data, Data Lakes and Delta Lakes.
• Strong knowledge of data governance, data quality standards, and regulatory compliance.
• Expertise in cloud and big data platforms, data lakes, and data architecture.
• Ability to translate business requirements into scalable data solutions aligned with strategic objectives.
• Prior experience with Infrastructure as code tools like Terraform and automation tools like Apache Airflow.
• Familiarity with AI technologies and prior experience with agents, LLMs is preferred.
• Proven capability to analyze complex data systems and deliver actionable business insights.
• Experience using Databricks and Snowflake is highly desirable.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures to support business analytics and machine learning initiatives.
• Extract, transform, and integrate data from various internal and external sources ensuring data quality and relevance.
• Collaborate with stakeholders to translate business requirements into effective data solutions aligned with enterprise strategy.
• Develop and optimize data models, including logical and physical designs, to enhance data accessibility and usability.
• Implement data governance practices to ensure compliance with regulatory and organizational standards.
• Utilize programming languages and tools such as SQL, Python, Spark and Apache Airflow for coding, testing, and deployment.
• Monitor and improve data processes to support continuous innovation and operational excellence.

Skills

Data engineering

ETL development

PySpark

SparkSQL

SQL

Python

Java

AWS

GCP

Delta Lakes

Data governance

Data quality

Cloud platforms

Terraform

Apache Airflow

Databricks

Snowflake

Education

Bachelor’s degree in Computer Science

Master’s degree in Computer Science

Tools

Databricks

Snowflake

Terraform

Apache Airflow

Job description

Walmart seeks a Senior Data Engineer to design and maintain scalable data pipelines and architectures supporting analytics and ML initiatives. You will work across teams to translate requirements into data solutions, ensure data quality, and enable access for data scientists and apps.

You will leverage SQL, Python, Spark, Airflow, and cloud services (AWS/GCP) while handling large-scale data lakes and Delta Lake architecture.