Lead Data Platform Engineer - Real-Time Streaming & Flink

Whatnot Inc.

United States

Remote

USD 190,000 - 270,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health Insurance
Work From Home Support
Home office setup allowance
Cell phone stipend
Wellness allowance
Childcare support

Job summary

Whatnot Inc. is seeking a seasoned Data Platform Engineer to define technical direction and lead the development of critical streaming systems powering real-time analytics and ML-ready infrastructure.

You will drive the Flink platform's growth from early investments to production-ready usage, designing scalable, multi-tenant streaming infra and owning SLOs and reliability. You will collaborate with cross-functional teams to ensure fast, safe, and scalable development across product, platform,

Qualifications

  • 5+ years of experience in building data platforms or streaming systems.
  • API-driven services that run at scale in production.
  • Experience with distributed systems and real-time data processing.
  • Experience evaluating architecture tradeoffs in stream processing, including Flink usage.
  • Ability to design and operate stateful real-time pipelines at scale.

Responsibilities

  • Define technical direction and lead development of data platform systems powering next-gen capabilities.
  • Lead buildout and evolution of Flink platform for streaming across the company.
  • Design scalable, multi-tenant streaming infrastructure and ensure operational excellence.
  • Own core platform concerns: scalability, performance, reliability, SLOs.
  • Build systems for real-time analytics, event-driven apps, and ML infra needs.
  • Collaborate with product, platform, ML, and data teams to realize architecture.
  • Shape the broader company architecture for stream processing and analytics.

Skills

Streaming data systems
Kafka
Flink
Pulsar
Python
Distributed systems
APIs
Cloud platforms
Terraform
Real-time analytics
Multi-tenant infra
Stateful processing

Tools

Kafka
Flink
Pulsar
Snowflake
BigQuery
Redshift
AWS
GCP
Terraform

Job description

Whatnot Inc. is seeking a seasoned Data Platform Engineer to define technical direction and lead the development of critical streaming systems powering real-time analytics and ML-ready infrastructure.

You will drive the Flink platform's growth from early investments to production-ready usage, designing scalable, multi-tenant streaming infra and owning SLOs and reliability. You will collaborate with cross-functional teams to ensure fast, safe, and scalable development across product, platform,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Real-Time Data Platform Engineer: Kafka & Flink
Remote Real-Time Data Platform Engineer: Kafka & Flink

TekValue IT Solutions • United States

On-site
USD 140,000 - 190,000
Flink Leader
Flink Leader

Weekday AI • United States

On-site
USD 180,000 - 240,000
Senior Flink Architect & Team Lead
Senior Flink Architect & Team Lead

Weekday • United States

On-site
USD 180,000 - 240,000
Data Foundations Engineer — Real-Time Platform
Data Foundations Engineer — Real-Time Platform

Whatnot Inc. • Los Angeles (CA)

On-site
USD 200,000 - 275,000
Health insurance options
Work-from-home setup allowance
Monthly phone/internet allowance
+6
Lead Data Platform Engineer — Real-Time Data & AI
Lead Data Platform Engineer — Real-Time Data & AI

Elastic • Mountain View (CA)

On-site
USD 113,000 - 179,000
Health coverage
Flexible schedules
Vacation days
+5
Real-Time Data Streaming Engineering Lead
Real-Time Data Streaming Engineering Lead

Weekday • United States

On-site
USD 160,000 - 230,000
Lead Real-Time Data Streaming Engineer (Flink, Kafka)
Lead Real-Time Data Streaming Engineer (Flink, Kafka)

Bank of America Corporation • Jersey City (NJ)

On-site
USD 140,000 - 200,000
Flink Manager
Flink Manager

Weekday • United States

On-site
USD 10,000,000 - 40,000,000
Real-Time Data Engineer — Flink & Kafka
Real-Time Data Engineer — Flink & Kafka

Gate.io • United States

Remote
USD 90,000 - 130,000
Lead Data Platform Engineer - Streaming & Lakehouse
Lead Data Platform Engineer - Streaming & Lakehouse

Accion Labs • United States

On-site
USD 180,000 - 260,000