Staff Data Infrastructure Engineer Staff

D8 LooP; New York (NY); On-site; USD 120,000 - 170,000; Full time

Job summary

Faire is a technology wholesale platform connecting independent retailers worldwide. We are seeking a data-focused engineer to architect and manage scalable data pipelines, ensure data quality, and enable analysts with reliable, streaming ingestion across systems.

You will own reliability metrics and collaborate with teams to reduce data latency and improve schema evolution handling. The role emphasizes building CDC/high-volume streaming workflows using modern data tooling and cloud platforms,

Qualifications

• Experience operating Airflow at scale and with managed ingestion like Fivetran.
• Experience with data quality and observability, including data contracts and SLAs.
• Strong Python plus at least one of Kotlin, Java, Scala, or Go.
• Strong SQL and data modeling for analysts and data scientists.
• Strong Spark skills; Databricks and Snowflake against shared storage.
• Deep experience with CDC and streaming ingestion from operational databases via Kafka.
• Knowledge of ordering, deduplication, late data, schema changes, and backfills.
• You understand issues with ordering, duplicates, snapshots, and schema evolution.
• Build CDC/streaming ingestion using CockroachDB, MySQL, Kafka, Iceberg on S3.
• Own reliability: SLOs, on-call, incident reviews, and follow-through.

Skills

Airflow orchestration

Data quality observability

Python

SQL

Spark

Streaming / CDC

Idempotency & backfills

Ordering, duplicates & schema changes

SLOs & on-call

Incremental loads

Tools

Fivetran

Anomalo

Monte Carlo

Databricks

Snowflake

Kafka

CockroachDB

MySQL

Iceberg

S3

Terraform

AWS

Airflow

Job description

Faire · boards.greenhouse.io · checked today

Faire is a technology wholesale platform built on the belief that the future is local. Independent retailers around the globe collectively represent a multi-hundred-billion-dollar wholesale market that has historically been fragmented and offline. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe.

Skills, with evidence

• Airflow / orchestration Experience operating Airflow at scale and working with managed ingestion like Fivetran. must have
• Experience with data quality and observability in practice, including data contracts, SLAs, and tools like Anomalo or Monte Carlo. must have
• Python Solid Python plus at least one of Kotlin, Java, Scala, or Go. must have
• SQL Strong SQL, and good instincts for how to model data so analysts and data scientists can actually use it. must have
• Spark Strong Spark skills, and experience running Databricks and Snowflake against shared storage. must have
• Streaming Deep experience with change data capture and streaming ingestion from operational databases through Kafka. must have
• Idempotency & backfills You'll be responsible for the hard details like ordering, deduplication, late data, schema changes, and backfills. must have
• You know what goes wrong with ordering, duplicates, snapshots, and schema evolution because you've dealt with it. must have
• AWS Experience shipping infrastructure on AWS with Terraform. must have · not practised here
• Terraform Experience shipping infrastructure on AWS with Terraform. must have · not practised here
• Warehousing Build the CDC and streaming ingestion layer: CockroachDB changefeeds and MySQL binlogs into Kafka, then into Iceberg tables on S3.
• Own reliability for the platform: SLOs, on-call, incident reviews, and the follow-through so the same thing doesn't break twice.
• Incremental loads Build the CDC and streaming ingestion layer: CockroachDB changefeeds and MySQL binlogs into Kafka, then into Iceberg tables on S3.
• Machine learning At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe. not practised here