Staff Data Engineer - Data Governance & Big Data Pipelines

Walmart Inc.; Sunnyvale (CA); Hybrid; USD 212.000 - 286.000; Vollzeit

Benefits dieser Stelle

Health benefits

401(k) matching

Stock purchase plan

Paid time off

Zusammenfassung

Walmart Inc. is seeking a Staff Data Engineer in Sunnyvale, CA to lead data governance initiatives and build scalable data pipelines. You will partner with business and tech teams to interpret policies and translate business problems into data-driven solutions.

The role involves designing data models, automating data prep, and ensuring data quality across multi-source inputs. The ideal candidate has deep experience with SQL, Python/Java/Scala, Databricks, Spark, and Airflow, plus

Qualifikationen

• Experience with SQL for data retrieval, transformation, and querying (SQL/JDBC).
• Experience writing code to develop robust and scalable data engineering pipelines with Python, Java, and Scala.
• Experience containerizing data engineering applications using Docker and deploying on Kubernetes.
• Experience with Databricks, Spark, SparkSQL and Hadoop ecosystems.

Aufgaben

• Establish, modify, and document data governance projects and recommendations.
• Implement data governance practices with stakeholders.
• Build the infrastructure for data transformation and integration from diverse sources.
• Deploy pipelines using scheduling and orchestration frameworks.
• Review data models and ensure quality across data sources.
• Monitor production pipelines and lead patches when needed.

Kenntnisse

SQL

Python

Java/Scala

Data pipelines

Docker

Kubernetes

Databricks/Spark

Airflow

CI/CD

Data governance

Ausbildung

Bachelor’s degree in CS/IT/Engineering

Master’s degree in CS/IT/Engineering

Tools

Docker

Kubernetes

Databricks

Apache Spark

Hadoop

Airflow

Jenkins

Ansible

REST APIs

PyTest

Jobbeschreibung

Walmart Inc. is seeking a Staff Data Engineer in Sunnyvale, CA to lead data governance initiatives and build scalable data pipelines. You will partner with business and tech teams to interpret policies and translate business problems into data-driven solutions.

The role involves designing data models, automating data prep, and ensuring data quality across multi-source inputs. The ideal candidate has deep experience with SQL, Python/Java/Scala, Databricks, Spark, and Airflow, plus