Lead Data Engineer - Lakehouse & Real-Time Platforms

Sprouts Farmers Market; Phoenix (AZ); Hybrid; USD 130,000 - 170,000; Full time

Benefits offered by this job

Competitive pay

15% family discount on purchases

401(k) Retirement plan with company ð—

Flexible schedules

Employee Assistance Program (EAP)

Paid holidays

Job summary

Sprouts Farmers Market is seeking a data engineering leader to drive technical objectives across a data platform, owning roadmaps for at least a year. The role partners with Store Support Office in Phoenix, with a hybrid schedule requiring in-office presence Tue–Thu.

You will guide architecture, governance, and real-time data initiatives, mentoring engineers and shaping cross-functional data solutions spanning ingestion, streaming, and feature stores.

Qualifications

• 7+ years of data engineering experience with cross-team technical leadership.
• Advanced knowledge of Spark, Flink, Airflow, dbt, or equivalent technologies.
• Experience with lakehouse technologies such as Iceberg, Delta Lake, or Hudi.
• Experience designing batch and streaming architectures using Kafka or equivalent.
• Experience with data governance, lineage, quality, and data-contract practices.
• Strong written and verbal communication skills, including architecture documentation.

Responsibilities

• Develop and recommend data engineering standards, patterns, and reference architectures for the assigned department or business unit.
• Lead major and complex initiatives involving ingestion, transformation, streaming, serving, and feature-store capabilities.
• Develop and implement governance, lineage, quality, and data-contract standards for assigned platforms and related data domains.
• Present technical recommendations to engineering leadership and cross-functional stakeholders and gain agreement on shared approaches.
• Lead lakehouse, data-product, and real-time decisioning initiatives within the assigned domain.
• Define resilient source-adapter patterns, including schema-drift quarantine, versioning, and replay after remediation.
• Provide technical guidance, coaching, and training to engineers and review work products for major initiatives.

Skills

Cross-team leadership

Communication

Leadership

Tools

Spark

Flink

Airflow

dbt

Iceberg

Delta Lake

Hudi

Kafka

Job description

Sprouts Farmers Market is seeking a data engineering leader to drive technical objectives across a data platform, owning roadmaps for at least a year. The role partners with Store Support Office in Phoenix, with a hybrid schedule requiring in-office presence Tue–Thu.

You will guide architecture, governance, and real-time data initiatives, mentoring engineers and shaping cross-functional data solutions spanning ingestion, streaming, and feature stores.