Senior Data Engineer: Customer Identity Platform

HEB; Austin (TX); On-site; USD 130,000 - 190,000; Full time

Job summary

H-E-B Digital Technology is seeking a Senior Data Engineer to design and build scalable data pipelines and data infrastructures, enabling analytics across the organization. You will collaborate with Product, Data Science, and Analytics teams to translate data needs into robust solutions, mentor peers, and uphold data quality.

You will work closely with stakeholders to deliver reliable data platforms using GCP services, modern data lakehouse concepts, and RESTful APIs, while contributing to SDLC

Qualifications

• 5+ years of experience related to data engineering.
• Experience with Lean Startup or Agile development methodologies.
• Experience working in large-scale infrastructure, large data sets, and mission-critical SLAs.

Responsibilities

• Design data patterns that support dataset creation for analytics and standardize data.
• Validate data quality and write automated tests.
• Maintain and streamline end-to-end data pipelines.
• Build complex data pipelines, APIs, data integrations, streaming solutions, and ML model implementations.
• Mentor junior Data Engineers and collaborate with stakeholders to define data needs.

Skills

Python

PySpark

SQL

Lean Startup / Agile methods

GCP

APIs / REST

CI/CD

Data pipelines

Big data

Education

Degree or related training

Tools

FastAPI

Dataproc

Cloud Dataflow

Airflow

BigQuery

Databricks

Job description

H-E-B Digital Technology is seeking a Senior Data Engineer to design and build scalable data pipelines and data infrastructures, enabling analytics across the organization. You will collaborate with Product, Data Science, and Analytics teams to translate data needs into robust solutions, mentor peers, and uphold data quality.

You will work closely with stakeholders to deliver reliable data platforms using GCP services, modern data lakehouse concepts, and RESTful APIs, while contributing to SDLC