Senior Data Engineer — Personalization & Data Platform

Mill; San Bruno (CA); On-site; USD 185,000 - 210,000; Full time

Job summary

Mill is a waste prevention technology company tackling food waste at its source. We are seeking a Data Engineer to architect data pipelines, own the end-to-end data warehouse, and ship actionable insights via a customer-facing recommendation engine.

You'll partner with product, engineering, data analytics, and marketing to ensure data quality, governance, and scalable analytics across Mill's product and operations. Salary ranges between $185k–$210k.

Qualifications

• Designed, built, or operated a recommendation system in production, combining multiple data sources into a single customer-facing output.
• Experience building recommendation or personalization logic using LLMs in a live product.
• Built data pipelines in production using Python, SQL, and tools like dbt, Airflow, Fivetran against a cloud data warehouse, including handling failures, backfills, and schema changes.
• Brought CI/CD discipline to data pipelines or product logic with automated testing and staged rollout.
• 5 years of experience operating data engineering systems in production.
• A bias toward clarity and action.

Responsibilities

• Build and operate the customer-facing recommendation engine that turns food waste data into actionable recommendations — purchasing suggestions, anomaly explanations, operational nudges — including LLM-based logic where useful
• Aggregate and unify disparate data streams to guarantee the precision, reliability, and protection of our analytical assets.
• Co-create and drive Mill's self-serve analytics strategy with analysts and data scientists — defining golden datasets, setting SLAs for freshness and reliability, and establishing the governance model that keeps self-serve trustworthy at scale
• Own data quality monitoring against those SLAs — build alerting, validation frameworks, and observability tooling so golden dataset issues get caught before they become business problems
• Collaborate with software engineers to instrument new product features and ensure event data flows cleanly into the warehouse, meeting the governance and quality bar required for it to become part of a golden dataset
• Design, build, and maintain scalable data pipelines across Mill's product and operational systems
• Define and maintain the metrics, table endorsements, and business logic that analysts and stakeholders rely on — so everyone across the company is working from the same numbers

Skills

Data modeling

Python

SQL

LLMs

CI/CD

Observability

Tools

dbt

Airflow

Fivetran

Snowflake

BigQuery

Redshift

Job description

Mill is a waste prevention technology company tackling food waste at its source. We are seeking a Data Engineer to architect data pipelines, own the end-to-end data warehouse, and ship actionable insights via a customer-facing recommendation engine.

You'll partner with product, engineering, data analytics, and marketing to ensure data quality, governance, and scalable analytics across Mill's product and operations. Salary ranges between $185k–$210k.