Senior Data Platform Engineer — Real-Time Multi-Tenant

Whatnot; New York (NY); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Generous Holiday and Time off Policy

Health Insurance options: Medical, 1DM

Work From Home Support

Home office setup allowance

Monthly allowance for cell phone and &

Job summary

Whatnot’s Data Platform team builds services that enhance our core product and unlock business value. You will define technical direction, lead streaming and orchestration platform builds, and design scalable, multi-tenant data infrastructure across the company.

You will own platform concerns like scalability, reliability, and SLOs while enabling real-time analytics, event-driven applications, and ML infrastructure needs. Collaboration with product, platform, ML, and data teams is essential.

Qualifications

• 8+ years of experience as a software engineer, with proven production systems.
• Experience building scalable distributed systems.
• Hands-on experience with streaming systems (Kafka, Flink, Pulsar) or orchestration platforms (Airflow, Dagster, Temporal).
• Experience designing and operating real-time data pipelines at scale.
• Experience evaluating architectural tradeoffs in data processing and orchestration.
• Experience building multi-tenant data infrastructure.
• Experience managing cloud data stores (Snowflake, BigQuery, Redshift) and data lake architectures (AWS S3).
• Strong operations experience: monitoring, alerting, incident management.
• Familiarity with DevOps/SRE and CI/CD tooling (GitHub Actions).
• Understanding of data governance and compliance principles.

Responsibilities

• Define technical direction and lead development of critical data platform systems that power next-generation capabilities at Whatnot.
• Lead the buildout and evolution of data orchestration and streaming platforms for production-ready usage company-wide.
• Design scalable, multi-tenant data infrastructure rather than just pipelines.
• Own platform concerns including scalability, performance, reliability, SLOs, and operational excellence.
• Build high-quality systems supporting real-time analytics, event-driven applications, and ML infrastructure needs.
• Make key decisions about data system integration and partner cross-functionally to implement architectures.
• Collaborate with product, platform, ML, and data teams to enable fast, safe, scalable development.
• Help shape company architecture across orchestration, stream processing, real-time systems, analytics, and content understanding.
• Apply DevOps/SRE practices to keep platform systems reliable at scale.
• Define and enforce data governance and compliance standards across data lake and downstream systems.

Skills

API-driven applications

Distributed systems

Streaming data systems

Data orchestration platforms

Real-time data pipelines

Cloud data stores

DevOps/SRE practices

CI/CD tooling

Data governance

Cross-functional collaboration

Tools

Kafka

Flink

Pulsar

Airflow

Dagster

Temporal

Snowflake

BigQuery

Redshift

AWS S3

Job description

Whatnot’s Data Platform team builds services that enhance our core product and unlock business value. You will define technical direction, lead streaming and orchestration platform builds, and design scalable, multi-tenant data infrastructure across the company.

You will own platform concerns like scalability, reliability, and SLOs while enabling real-time analytics, event-driven applications, and ML infrastructure needs. Collaboration with product, platform, ML, and data teams is essential.