Senior Data Engineer: Scalable Big Data Pipelines

Walmart Inc.; Bentonville (AR); Hybrid; USD 127,000 - 220,000; Full time

Benefits offered by this job

Health benefits

401(k)

Stock purchase

Paid time off

Education assistance with 100% company

Company discounts

Adoption expense reimbursement

Job summary

Walmart Inc. in Bentonville, AR seeks a Staff Data Engineer to design and implement scalable data pipelines and data models across multiple data platforms. You will translate business problems into data-driven solutions, collaborate with stakeholders, and drive data governance and quality initiatives.

The role requires deep experience with Hadoop/Spark ecosystems, cloud platforms, and modern orchestration tools. You will mentor junior engineers and contribute to architecture decisions.

Qualifications

• Experience designing scalable big data pipelines and ETLs using Hadoop, Hive, Spark, and Databricks.
• Experience with Scala, Python, Spark, and SQL for ETL development.
• Strong SQL and Spark SQL querying for data analysis and validation.
• Experience in cloud ecosystems (GCP, AWS, Azure).

Responsibilities

• Translate business problems into data-driven solutions and select appropriate methods.
• Recommend business insights and build business cases for ROI.
• Identify and source data fit for purpose; ensure data quality.
• Build data infrastructure for transformation and integration from multiple sources.
• Develop and maintain complex data models and documentation.
• Develop and test code, review engineering designs, and ensure scalable deployments.
• Establish data governance practices and educate stakeholders.

Skills

Big data pipelines

ETL development

Python

SQL

Spark

Hadoop/Hive

Databricks

Cloud platforms (GCP/AWS/Azure)

Airflow/Oozie/Autosys

Data modeling

Education

Bachelor's degree in Computer Science or related field

Master’s degree in Computer Science or related field

Tools

Apache Airflow

Oozie

AutoSys

Confluence

Jira

Azure DevOps

Databricks

Hadoop

Hive

Snowflake

Parquet/AVRO/JSON/CSV

S3/GCS/Azure Blob Storage

Job description

Walmart Inc. in Bentonville, AR seeks a Staff Data Engineer to design and implement scalable data pipelines and data models across multiple data platforms. You will translate business problems into data-driven solutions, collaborate with stakeholders, and drive data governance and quality initiatives.

The role requires deep experience with Hadoop/Spark ecosystems, cloud platforms, and modern orchestration tools. You will mentor junior engineers and contribute to architecture decisions.