Staff Data Ingestion Platform Engineer

Reddit, Inc.; United States; On-site; USD 217,000 - 304,000; Full time

Benefits offered by this job

Equity (RSUs)

Medical insurance

Dental insurance

Vision insurance

401(k) with employer match

Generous time off

Parental leave

Job summary

Reddit is hiring a Staff Software Engineer to lead the development and evolution of Reddit's Ingestion Platform. You will design and deliver reliable software for distributed data movement across streaming and batch workloads, with a focus on availability, scalability, latency, and cost efficiency.

You will own architecture of the platform's control and data planes, and expand beyond Kafka to S3/GCS and Iceberg.

Qualifications

• 10+ years of hands-on experience building internet-scale distributed systems, data infrastructure, or platforms used by developers.
• BS, MS, PhD in Computer Science or equivalent practical experience.
• Strong software development experience in Go, Python, Java, or Scala.
• Deep experience designing and operating high-throughput data pipelines or platform services.

Responsibilities

• Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads.
• Own the architecture and evolution of the platform's control plane and data plane.
• Expand the platform beyond Kafka-to-BigQuery toward S3/GCS and Apache Iceberg.
• Build connectors and abstractions for Kafka, BigQuery, S3, GCS, Iceberg, Flink.
• Improve the self-service experience with clear APIs, documentation, and observability.
• Lead migrations from legacy ingestion systems to the Ingestion Platform.

Skills

Distributed systems

Platform design

Go

Python

Java

Scala

Education

BS/MS/PhD in Computer Science

Tools

Kafka

BigQuery

S3

GCS

Iceberg

Flink

Protobuf

gRPC

Kubernetes

Job description

Reddit is hiring a Staff Software Engineer to lead the development and evolution of Reddit's Ingestion Platform. You will design and deliver reliable software for distributed data movement across streaming and batch workloads, with a focus on availability, scalability, latency, and cost efficiency.

You will own architecture of the platform's control and data planes, and expand beyond Kafka to S3/GCS and Iceberg.