Senior Data Engineer - Customer Identity Platform

HEB; Austin (TX); On-site; USD 140,000 - 180,000; Full time

Job summary

HEB in Austin, TX is seeking a Senior Data Engineer to strengthen customer and identity resolution through reliable data patterns, pipelines, and integrations. You will design scalable batch and real-time solutions and mentor junior engineers while partnering with Product, Data Science, Application, and Analytics teams.

You will validate data quality, build data integrations and APIs, and contribute to architecture, security, scalability, reliability, and performance across the data platform.

Qualifications

• Bachelor's degree in CS or related field.
• 5+ years of data engineering experience.
• Experience with Lean Startup or Agile development methodologies.
• Experience with large-scale infrastructure, large data sets, and mission-critical SLAs.
• High proficiency in Python, PySpark, and SQL for data manipulation and pipeline development.

Responsibilities

• Design data patterns for analytics datasets, including cleansing and mapping across sources.
• Validate data quality and write automated tests.
• Maintain end-to-end data pipelines and build advanced pipelines and APIs.
• Collaborate with product, data science, and analytics teams to deliver solutions.
• Mentor junior engineers and contribute to architecture, security, reliability, and performance.
• Design and develop data integrations for application engineering and system integration.

Skills

Agile methodologies

Mentoring

Communication

Data modeling

Learning new tech

Education

Bachelor's degree in CS or related field

Tools

Python

PySpark

SQL

Google Cloud Platform (GCP)

Dataproc

Dataflow

Airflow (Cloud Composer)

Cloud Storage / Pub/Sub

Databricks

BigQuery

FastAPI & REST APIs

ETL/ELT

CI/CD & Git

Job description

HEB in Austin, TX is seeking a Senior Data Engineer to strengthen customer and identity resolution through reliable data patterns, pipelines, and integrations. You will design scalable batch and real-time solutions and mentor junior engineers while partnering with Product, Data Science, Application, and Analytics teams.

You will validate data quality, build data integrations and APIs, and contribute to architecture, security, scalability, reliability, and performance across the data platform.