Lead Data Engineer: SAP/Databricks Transformation (Hybrid)

Loyalty360; Milford Terrace (NC); Hybrid; USD 160,000 - 240,000; Full time

Job summary

Ahold Delhaize USA is seeking an enterprise data platform leader to define vision, architecture, and operating model for data platforms and products. You will enable secure, scalable data solutions for analytics, reporting, and ML across the business.

Role requires guiding cloud services, IaC, data governance, and self-service tooling. Hybrid work with 3 days in Salisbury, NC, and 2 remote days. Applicants must be authorized to work in the United States.

Qualifications

• Bachelor's degree or equivalent years of work experience.
• 12+ years in data/platform engineering with enterprise scope and measurable impact.
• Mastery of data architecture (streaming and batch), lake/lakehouse/warehouse patterns, governance, and security.
• Proven leadership of automation, CI/CD for data, and observability at scale.
• Executive level communication, influence, and stakeholder alignment.
• Deep expertise with Databricks and modern lakehouse architecture, including Spark-based processing, Delta Lake, governance, performance optimization, and production operations.
• Demonstrated experience designing, building, testing, and operating scalable batch and real-time data pipelines using SQL and Python/Scala.
• Strong knowledge of REST APIs, event-driven architectures, and streaming technologies such as Kafka or comparable platforms.
• Strong background in reporting and analytics, including data modeling and delivery of trusted, analytics-ready datasets for enterprise consumption.
• Proven ability to communicate complex technical concepts to technical and non-technical audiences, manage stakeholders, influence across teams, and serve as a bridge among engineering, business, and transformation teams.
• Practical interest and experience in AI, Generative AI, and emerging technologies, supported by a demonstrated passion for continuous learning.

Responsibilities

• Set the north star data architecture (batch/streaming, lakehouse, MDM, governance) and establish actionable standards, guardrails, and reference implementations.
• Establish product-oriented platform capabilities (self-service ingestion, transformation, orchestration, catalog/lineage, quality) and internal tooling.
• Define and drive automation standards, including CI/CD pipelines for data platforms and services.
• Embed security, privacy, and compliance by design, enforcing policies with automation.
• Orchestrate reliability and observability across pipelines and platforms (SLOs, telemetry, remediation).
• Guide cloud service integration and container/orchestration strategy for cost-effective scale.
• Maintain infrastructure as code practices (Terraform, Ansible, CloudFormation).
• Prioritize roadmaps using measurable value and data consumer outcomes; evaluate new technologies.
• Collaborate with dev teams to provide reusable components and platform patterns.
• Mentor engineers, grow a community of practice, raise engineering quality.
• Support critical escalations and urgent IT incidents when needed.
• Design and build reusable data engineering frameworks used across squads.
• Develop, manage and optimize data pipelines from SAP and legacy platforms to the data lake.
• Harmonize data from legacy systems into SAP with governance and reconciliation controls.
• Provide hands-on leadership for Microsoft Data Ecosystem, Databricks and SAP Data Cloud solutions.
• Drive Reporting & Analytics strategy and API-driven/event-streaming data access.

Skills

Executive level communication

Databricks

Lakehouse architecture

CI/CD for data

Data governance

Security & compliance

Python or Scala

REST APIs

Generative AI interest

Leadership

Executive stakeholder management

Education

Bachelor's degree or equivalent years of work experience

Tools

Databricks

Delta Lake

Spark

Terraform

Ansible

CloudFormation

REST APIs

Job description

Ahold Delhaize USA is seeking an enterprise data platform leader to define vision, architecture, and operating model for data platforms and products. You will enable secure, scalable data solutions for analytics, reporting, and ML across the business.

Role requires guiding cloud services, IaC, data governance, and self-service tooling. Hybrid work with 3 days in Salisbury, NC, and 2 remote days. Applicants must be authorized to work in the United States.