Remote Staff Data Ingestion Platform Engineer

Reddit, Inc.; Northern (KY); Hybrid; USD 217,000 - 304,000; Full time

Benefits offered by this job

Equity

Health benefits (medical, dental, and視

401(k) match

Paid time off

Parental leave

Job summary

Reddit, Inc. is seeking a Staff Software Engineer to lead the development and evolution of the Ingestion Platform, enabling reliable, scalable data movement across streaming and batch workloads.

You will own platform APIs, connectors, and migrations from legacy systems, while mentoring engineers and partnering with Ads Data Platform, ML Indexing, and other teams to drive reliability and developer velocity.

Qualifications

• 10+ years of hands-on experience building internet-scale distributed systems, data infrastructure, or platforms used by other developers.
• BS, MS, PhD in Computer Science, a related field, or equivalent practical experience.
• Strong software development experience in Go, Python, Java, or Scala.
• Deep experience designing and operating high-throughput, fault-tolerant data pipelines or platform services, incl. streaming and batch processing.
• Experience with data movement patterns and systems such as Kafka, BigQuery, S3, GCS, Iceberg, Flink, or comparable technologies.
• Experience designing APIs and platform abstractions, including schema evolution and gRPC.

Responsibilities

• Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads.
• Own the architecture and evolution of the platform’s control plane and data plane, including APIs, controllers, connectors, sink integrations.
• Expand the platform beyond Kafka-to-BigQuery towards S3/GCS and Iceberg, with transformations and dead-letter handling.
• Build connectors and abstractions for Kafka, BigQuery, S3, GCS, Iceberg, Flink and other data stores.
• Improve self-service experience with clear APIs, safe defaults, provisioning, docs, and observability.
• Lead migrations from legacy ingestion systems to the Ingestion Platform with cross-team collaboration.
• Establish reliability, security, and ops practices across Kubernetes clusters.

Skills

Go / Python / Java / Scala

Distributed systems

Data pipelines

Education

BS/MS/PhD in Computer Science or related field

Tools

Kafka

BigQuery

S3 / GCS

Iceberg

Flink

Kubernetes

Job description

Reddit, Inc. is seeking a Staff Software Engineer to lead the development and evolution of the Ingestion Platform, enabling reliable, scalable data movement across streaming and batch workloads.

You will own platform APIs, connectors, and migrations from legacy systems, while mentoring engineers and partnering with Ads Data Platform, ML Indexing, and other teams to drive reliability and developer velocity.