Data Engineer

The Farmer's Dog; New York (NY); On-site; USD 110,000 - 170,000; Full time

Benefits offered by this job

Dog-friendly offices

Equity packages

Health insurance

Dental insurance

Vision insurance

401k match

Parental leave

Flexible PTO

Remote work policy

Discounted dog food

Pet video calls

Job summary

The Farmer's Dog is seeking a data engineer to build and maintain data pipelines supporting reporting, analytics, and AI/ML workflows. You will ingest data from APIs and databases, process millions of events daily, and help scale our data infrastructure.

You will implement governance, monitoring, and data quality checks, collaborate with cross-functional teams, and document technical implementations while promoting best practices and continuous learning.

Qualifications

• 2–4 years in data engineering or related field.
• Experience with building data pipelines for analytics/AI use cases.
• Proficient in Python and SQL with production coding experience.

Responsibilities

• Build and maintain data pipelines for structured and unstructured data.
• Write production-level code processing millions of events per day.
• Develop AI tooling and automation to enhance workflows.
• Ingest data from APIs, databases, files, and streaming platforms.
• Establish robust data governance across the data warehouse.
• Implement monitoring, data quality checks, and alerts.
• Support production data systems and resolve data incidents.
• Document implementations and promote best practices.

Skills

Data pipeline development

Python production code

SQL data transformations

Airflow / orchestration

DBT tooling

REST APIs data ingests

ETL/ELT concepts

Data governance

Problem solving

Collaboration

Tools

DBT

Airflow

Job description

• Build and maintain data pipelines for structured and unstructured data supporting reporting, analytics and AI/ML use cases
• Write production-level code that processes and validates millions of events per day
• Develop AI tooling and automation to enhance data engineering capabilities and workflows
• Ingest data from APIs, databases, file systems, and streaming platforms into our data infrastructure, and build and maintain pipelines for structured and unstructured data that support reporting, analytics, and AI/ML use cases
• Establish and maintain robust data governance frameworks across our data warehouse to ensure data integrity, reliability, and security across the organization
• Implement monitoring, data quality checks, and alerting to ensure pipeline reliability and implement automated checks
• Support production data systems and help resolve data-related incidents
• Document technical implementations, follow engineering best practices, and foster a collaborative team environment that promotes knowledge sharing, standard methodologies, continuous improvement, and continuous learning

Benefits

• Dog-friendly offices
• Equity packages
• Healthcare, Dental, and Vision insurance
• 401k match
• 12-week paid parental leave
• Flexible PTO and work-from-home policy
• Discounted fresh dog food
• Your pet interrupting video calls and in-person meetings is now a feature, not a bug

You love dogsYou’re detail-oriented with strong problem-solving skills and can manage multiple priorities effectivelyYou’re comfortable collaborating with cross-functional teams to understand data requirements and deliver solutions and you have experience communicating technical concepts effectively to both technical and non-technical stakeholdersYou have 2-4 years of experience in data engineering, software engineering, or related technical fieldYou have experience or strong interest in AI/ML workflows and tooling, including data preparation for machine learning models -> bring this one upYou’re familiar with data processing tools like DBT, Airflow, or similar orchestration frameworksYou’re proficient in Python with experience writing production code, and have solid SQL skills for data transformation and analysisYou have practical experience with REST APIs and data integration patterns for ingesting data from multiple sourcesYou understand ETL/ELT concepts and have built data pipelines independently with minimal guidanceYou are eager to learn new technologies, expand your skill set in a fast-paced environment, and take initiative to optimize systems