Data Engineer — Scalable Pipelines & Recommendations

Mill; San Bruno (CA); On-site; USD 185,000 - 210,000; Full time

Job summary

Mill is seeking a Data Engineer in California to own end-to-end data systems from ingestion to customer-facing recommendations. You will architect data warehouse models, tune recommendation logic, and collaborate with product, engineering, analytics, and marketing teams to drive insight and impact.

You will design and maintain scalable pipelines, operate the recommendation engine with multi-source data, and ensure data quality with monitoring and CI/CD practices.

Qualifications

• 5+ years of experience operating data engineering systems in production.
• Proficient in Python and data tooling (dbt, Airflow, Fivetran).
• Strong SQL skills and experience with a cloud data warehouse (Snowflake, BigQuery, Redshift).
• Experience with recommendation systems or multi-source data pipelines.
• Experience with CI/CD for data pipelines and model updates.

Responsibilities

• Design, build, and maintain scalable data pipelines across Mill's product and operational systems.
• Operate the customer-facing recommendation engine, including LLM-based logic when useful.
• Design transformation pipelines for food data from multiple sources.
• Partner with analytics and marketing for self-serve tools.
• Own data quality monitoring and observability tooling.

Skills

Python

SQL

dbt

Airflow

Fivetran

CI/CD

LLM-based logic

data pipelines

cloud data warehouse

Tools

dbt

Airflow

Fivetran

Terraform

Job description

Mill is seeking a Data Engineer in California to own end-to-end data systems from ingestion to customer-facing recommendations. You will architect data warehouse models, tune recommendation logic, and collaborate with product, engineering, analytics, and marketing teams to drive insight and impact.

You will design and maintain scalable pipelines, operate the recommendation engine with multi-source data, and ensure data quality with monitoring and CI/CD practices.