Staff Data Engineer

Sam's West, Inc.; Sunnyvale (CA); Hybrid; USD 212,000 - 286,000; Full time

Benefits offered by this job

Health benefits

401(k) matching

Stock purchase plan

Paid time off

Job summary

Walmart Inc. is seeking a Staff Data Engineer in Sunnyvale, CA to lead data governance initiatives and build scalable data pipelines. You will partner with business and tech teams to interpret policies and translate business problems into data-driven solutions.

The role involves designing data models, automating data prep, and ensuring data quality across multi-source inputs. The ideal candidate has deep experience with SQL, Python/Java/Scala, Databricks, Spark, and Airflow, plus

Qualifications

• Experience with SQL for data retrieval, transformation, and querying (SQL/JDBC).
• Experience writing code to develop robust and scalable data engineering pipelines with Python, Java, and Scala.
• Experience containerizing data engineering applications using Docker and deploying on Kubernetes.
• Experience with Databricks, Spark, SparkSQL and Hadoop ecosystems.

Responsibilities

• Establish, modify, and document data governance projects and recommendations.
• Implement data governance practices with stakeholders.
• Build the infrastructure for data transformation and integration from diverse sources.
• Deploy pipelines using scheduling and orchestration frameworks.
• Review data models and ensure quality across data sources.
• Monitor production pipelines and lead patches when needed.

Skills

SQL

Python

Java/Scala

Data pipelines

Docker

Kubernetes

Databricks/Spark

Airflow

CI/CD

Data governance

Education

Bachelor’s degree in CS/IT/Engineering

Master’s degree in CS/IT/Engineering

Tools

Docker

Kubernetes

Databricks

Apache Spark

Hadoop

Airflow

Jenkins

Ansible

REST APIs

PyTest

Job description

This notice is being provided as a result of the filing of an Application for Permanent Alien Labor Certification. Any person may provide documentary evidence bearing on the application to the Certifying Officer of the Department of Labor: U.S. Department of Labor, Employment and Training Administration, Office of Foreign Labor Certification, 200 Constitution Avenue, NW, Room N-5311, Washington, DC 20210

Position

Staff Data Engineer

Job Location

1375 Crossman Avenue, Sunnyvale, CA 94089

Duties

• Establish, modify, and document data governance projects and recommendations.
• Implements data governance practices in partnership with business stakeholders and peers.
• Interprets company and regulatory policies on data.
• Educates others on data governance processes, practices, policies, and guidelines.
• Provides recommendations on needed updates or inputs into data governance policies, practices, or guidelines.
• Translate/ co‑own business problems within one's discipline to data related or mathematical solutions.
• Identifies appropriate methods/tools to be leveraged to provide a solution for the problem.
• Shares use cases and give examples to demonstrate how the method would solve the business problem.
• Understand the priority order of requirements and service level agreements.
• Defines and identifies the most suitable sources for required data that is fit for purpose, referring to external sources as required.
• Performs initial data quality checks on the extracted data.
• Reviews the deliverables of junior associates and provides guidance on data source and quality.
• Build the infrastructure required for optimal transformation and integration from a wide variety of data sources using appropriate data integration technologies.
• Uses modern tools, techniques, and architecture to partially or completely automate the most common, repeatable and tedious data preparation and integration tasks.
• Deploys pipelines using scheduling and orchestration frameworks.
• Evaluates impacts of data issues and risks at an early stage.
• Identifies needs and creates methods to fuse and reshape complex, multi‑source data and make it usable for modeling.
• Updates knowledge of current and emerging big data analytics and data science trends and techniques.
• Build complex logical and conceptual models and provide guidance to team on physical data models.
• Identifies and defines the appropriate techniques for exposing data to other systems.
• Reviews and provides guidance and input on all data modeling activities to team members.
• Creates and maintains critical data documentation and metadata that allows data to be understood and leveraged as a shared asset.
• Assists in defining data modeling standards and foundational best practices.
• Provides inputs to the architectural design to make best use of the available resources, given goals, and expected loads.
• Review the solution and application design to ensure it meets business, technical, and data requirements.
• Identifies language and libraries to use in the development process.
• Maps test cases to business and functional requirements.
• Creates proof of concepts.
• Reviews and troubleshooting code in line with final designs.
• Identifies and recommends the appropriate testing methodology.
• Identifies the environment(s) for deployment.
• Identifies and recommends modifications of application based on different environmental requirements.
• Identifies modifications needed for scalability and drives the change.
• Monitors applications in production and leads development of patches where required.
• Reviews and ensures all code documentation is complete and updated periodically.
• Understand, articulate, interpret, and apply the principles of the defined strategy to unique, moderately complex business problems that may span one or more functions or domains.

Minimum Education and Experience Required

Bachelor’s degree or equivalent in Computer Science, Information Technology, Engineering (Any), or related field and 4 years of experience in software engineering or related field; OR Master’s degree or equivalent in Computer Science, Information Technology, Engineering (Any), or related field and 2 years of experience in software engineering or related field.

Skills Required

• Experience with SQL for data retrieval, extraction, transformation, and querying (SQL/JDBC).
• Experience writing code to develop robust and scalable data engineering pipelines by leveraging programming languages including Python, Java, and Scala and business, technical, and data requirements.
• Experience containerizing data engineering applications using Docker and deploying containerized workloads on Kubernetes for scalable and reliable production environments.
• Experience architecting and engineering Big Data solutions using Databricks, Apache Spark, SparkSQL and Hadoop ecosystems.
• Experience building and deploying solutions on public Cloud Platforms including Google Cloud Platform and Databricks.
• Experience developing real‑time and batch data systems including data cleansing, transformation, and loading processes using Apache Spark, Spark Streaming, Kafka.
• Experience orchestrating data pipelines using Apache Airflow.
• Experience designing and automating CI/CD pipelines using Jenkins, and Ansible.
• Experience troubleshooting business and production data issues to identify root causes and maintain SLAs.
• Experience implementing Data Quality checks, row‑level comparisons, and hash‑based validation to ensure accuracy of data.
• Experience with data modeling and developing logical and physical data models to support transactional systems, analytical systems, and data lakes.
• Experience designing and implementing REST API web services using Java/Python.
• Experience implementing Data Governance frameworks for metadata management, schema validation, data asset cataloguing.
• Experience creating units, integration, and load test cases using PyTest and custom validation frameworks.
• Experience monitoring and alerting production pipelines on failures and implementing custom logging solutions to ensure system reliability.
• Experience creating proof of concepts to evaluate the feasibility of cutting‑edge data and cloud technologies.

Employer Will Accept Any Amount of Experience With The Required Skills

Employer will accept any amount of experience with the required skills. Experience with any amount of experience with the required skills.

Salary and Compensation

Salary Range: $212,326/year to $286,000/year. Additional compensation includes annual or quarterly performance incentives.

Benefits

• At Walmart, we offer competitive pay as well as performance‑based incentive awards and other great benefits for a happier mind, body, and wallet.
• Health benefits include medical, vision and dental coverage.
• Financial benefits include 401(k), stock purchase and company‑paid life insurance.
• Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty and voting.
• Other benefits include short‑term and long‑term disability, education assistance with 100% company paid college degrees, company discounts, military service pay, adoption expense reimbursement, and more.
• Eligibility requirements apply to some benefits and may depend on your job classification and length of employment.
• Benefits are subject to change and may be subject to a specific plan or program terms.
• For information about benefits and eligibility, see One.Walmart.com.

Equal‑Opportunity Employer Statement

Wal‑Mart is an Equal Opportunity Employer.

Drug‑Free Workplace Policy

Walmart and its subsidiaries are committed to maintaining a drug‑free workplace and has a no‑tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.

Company Story

Fifty years ago, Sam Walton started a single mom‑and‑pop shop and transformed it into the world's biggest retailer. Since those founding days, one thing has remained consistent: our commitment to helping our customers save money so they can live better. Today, we're reinventing the shopping experience and our associates are at the heart of it. You'll play a crucial role in shaping the future of retail, improving millions of lives around the world. This is that place where your passions meet purpose. Join our family and create a career you're proud of.