Senior Data Foundations Engineer — Real-Time Data Platform

Whatnot; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health Insurance

Work From Home Support

Parental Leave

401(k) Retirement Plan

Dogfood allowance

Paid time off

Job summary

Whatnot is seeking an experienced Software Engineer, Data Foundations, to lead the design and development of scalable data platform systems. You will own orchestration and streaming platforms, ensuring reliability and efficient data processing across real-time analytics and ML workloads.

You will collaborate with product, platform, ML and data teams, driving architectural decisions and governance across data lake and downstream systems while applying robust DevOps practices.

Qualifications

• Experience writing well-tested, API-driven services

Responsibilities

• Define technical direction and lead development of critical data platform systems
• Lead the buildout and evolution of data orchestration and streaming platforms
• Design scalable, multi-tenant data infrastructure
• Own core platform concerns including scalability, performance, reliability, SLOs
• Build systems that support real-time analytics and ML infrastructure
• Make key data system integration decisions and drive architecture
• Collaborate with product, platform, ML and data teams for scalable development
• Shape architecture across orchestration, stream processing, real-time systems and analytics
• Apply DevOps/SRE practices to keep platforms reliable at scale
• Define and enforce data governance and compliance standards across data lake and downstream systems

Skills

API-driven services

Distributed systems

Real-time data processing

Stateful streaming pipelines

Cloud data stores

CI/CD & DevOps

Tools

Kafka

Flink

Pulsar

Airflow

Dagster

Temporal

Snowflake

BigQuery

Redshift

AWS

Google Cloud

Terraform

GitHub Actions

Job description

Whatnot is seeking an experienced Software Engineer, Data Foundations, to lead the design and development of scalable data platform systems. You will own orchestration and streaming platforms, ensuring reliability and efficient data processing across real-time analytics and ML workloads.

You will collaborate with product, platform, ML and data teams, driving architectural decisions and governance across data lake and downstream systems while applying robust DevOps practices.