Staff Data Platform Engineer — Scale & Reliability

Faire Wholesale Inc.; Toronto; Hybrid; CAD 216.000 - 297.000; Vollzeit

Benefits dieser Stelle

Equity

Competitive benefits

Hybrid work schedule

Zusammenfassung

Faire Wholesale Inc. is seeking a Staff Engineer to own the data plumbing that powers our analytic platform.

You will design and build the next-gen movement of data from production databases into analytical stores, partnering with data scientists, analysts, and engineers across the company. You’ll own the CDC/streaming ingestion, ensure data quality and governance, and drive reliability and scalable pipelines using Snowflake, Iceberg on S3, Kafka, Airflow, and Fivetrank.

Qualifikationen

• Built and run data infrastructure at meaningful scale and set direction for it.
• Deep experience with change data capture and streaming ingestion from operational databases through Kafka.
• Hands-on with lakehouse architectures using Iceberg on S3; discuss partitioning, compaction, catalogs, and copy-on-write vs merge-on-read.
• Strong Spark skills; experience with Databricks and Snowflake against shared storage.
• Experience with data quality and observability, including data contracts, SLAs, and tools like Anomalo or Monte Carlo.
• Experience operating Airflow and managed ingestion like Fivetran at scale.
• Strong SQL; good data modelling instincts for analysts and data scientists.
• Solid Python and at least one of Kotlin/Java/Scala/Go; Terraform on AWS.

Aufgaben

• Set the technical direction for moving data from production systems to analytical stores.
• Build the CDC and streaming ingestion layer (CockroachDB changefeeds, MySQL binlogs to Kafka, then Iceberg on S3).
• Own data contracts and quality checks across the platform.
• Define datasets’ ownership and SLAs; integrate data quality alerts (Anomalo, Monte Carlo).
• Maintain and optimize Airflow and Fivetran; decide what to buy vs build.
• Own platform reliability: SLOs, on-call, incident reviews.
• Lead cross-team migrations of pipelines without breaking dependencies.
• Mentor engineers and raise data engineering practice.

Kenntnisse

Change data capture

Streaming ingestion

Data engineering leadership

SQL

Python

Spark

Terraform

AWS

Databricks

Ausbildung

Bachelor's degree in CS/related field

Tools

Kafka

Airflow

Fivetran

Iceberg on S3

Snowflake

Databricks

CockroachDB

MySQL

Jobbeschreibung

Faire Wholesale Inc. is seeking a Staff Engineer to own the data plumbing that powers our analytic platform.

You will design and build the next-gen movement of data from production databases into analytical stores, partnering with data scientists, analysts, and engineers across the company. You’ll own the CDC/streaming ingestion, ensure data quality and governance, and drive reliability and scalable pipelines using Snowflake, Iceberg on S3, Kafka, Airflow, and Fivetrank.