Data Engineer: AI/ML Pipelines & Data Governance

The Farmer's Dog; New York (NY); On-site; USD 110,000 - 170,000; Full time

Benefits offered by this job

Dog-friendly offices

Equity packages

Health insurance

Dental insurance

Vision insurance

401k match

Parental leave

Flexible PTO

Remote work policy

Discounted dog food

Pet video calls

Job summary

The Farmer's Dog is seeking a data engineer to build and maintain data pipelines supporting reporting, analytics, and AI/ML workflows. You will ingest data from APIs and databases, process millions of events daily, and help scale our data infrastructure.

You will implement governance, monitoring, and data quality checks, collaborate with cross-functional teams, and document technical implementations while promoting best practices and continuous learning.

Qualifications

• 2–4 years in data engineering or related field.
• Experience with building data pipelines for analytics/AI use cases.
• Proficient in Python and SQL with production coding experience.

Responsibilities

• Build and maintain data pipelines for structured and unstructured data.
• Write production-level code processing millions of events per day.
• Develop AI tooling and automation to enhance workflows.
• Ingest data from APIs, databases, files, and streaming platforms.
• Establish robust data governance across the data warehouse.
• Implement monitoring, data quality checks, and alerts.
• Support production data systems and resolve data incidents.
• Document implementations and promote best practices.

Skills

Data pipeline development

Python production code

SQL data transformations

Airflow / orchestration

DBT tooling

REST APIs data ingests

ETL/ELT concepts

Data governance

Problem solving

Collaboration

Tools

DBT

Airflow

Job description

The Farmer's Dog is seeking a data engineer to build and maintain data pipelines supporting reporting, analytics, and AI/ML workflows. You will ingest data from APIs and databases, process millions of events daily, and help scale our data infrastructure.

You will implement governance, monitoring, and data quality checks, collaborate with cross-functional teams, and document technical implementations while promoting best practices and continuous learning.