Senior Data Engineer: Data Pipelines, GCP & BigQuery

Walmart; Charleston (SC); Remote; USD 27,552 - 41,328; Full time

Job summary

Walmart Worldwide Tech seeks a Senior Data Engineer to design and optimize data pipelines and models. You will craft scalable data solutions, work with SQL and Python/Scala, and leverage Google Cloud Platform services to support analytics and data science initiatives.

The role involves collaborating with cross-functional teams to translate requirements into robust data architectures and ensure high data quality across datasets and storage systems.

Qualifications

• Demonstrated active involvement with SQL and query development.
• Proficient hands-on experience in Scala or Python.
• Experience in Google Cloud Platform (GCP).
• Experience with BigQuery and Dataproc.

Responsibilities

• Examine complex data components, schemas, data pipelines, conditions, and relationships to model data for analysis.
• Lead medium-to-large data projects by translating requirements into technical designs and delivering on schedule.
• Develop data APIs and ensure data quality checks; manage data storage and metadata.
• Form data pipelines on Google Cloud Platform while adhering to security standards.

Skills

SQL

Python/Scala

Communication

Mentorship

Education

Bachelor's degree

Tools

GCP

BigQuery

Dataproc

Data pipelines

Job description

Walmart Worldwide Tech seeks a Senior Data Engineer to design and optimize data pipelines and models. You will craft scalable data solutions, work with SQL and Python/Scala, and leverage Google Cloud Platform services to support analytics and data science initiatives.

The role involves collaborating with cross-functional teams to translate requirements into robust data architectures and ensure high data quality across datasets and storage systems.