Software Engineer, Ingestion Platform

Reddit; Oregon; Hybrid; USD 164,000 - 230,000; Full time

Benefits offered by this job

Comprehensive Healthcare Benefits and

401k with Employer Match

Global Benefit programs that fit your

Family Planning Support

Gender-Affirming Care

Mental Health & Coaching Benefits

Flexible Vacation & Paid Volunteer TIm

Generous Paid Parental Leave

Job summary

Reddit is seeking a Software Engineer to join the Ingestion Platform team, tackling large-scale data movement across streaming and batch workloads. You will shape the control and data planes, build connectors for Kafka, BigQuery, S3, GCS, Iceberg, and more, and deliver safe, scalable, and observable pipelines.

Collaborate with Infrastructure, Data Platform, Ads, ML, and partnered groups to migrate legacy systems, ensure security and reliability, and enable Reddit's continued growth while

Qualifications

• 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code.
• Proficient in object-oriented programming languages like Python, Scala, Go, or Java.
• Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects.
• Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure.
• Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context.

Responsibilities

• Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads, with a focus on availability, scalability, latency, correctness, and cost efficiency.
• Contribute to the architecture and evolution of the platform's control plane and data plane, including pipeline APIs, controllers, connectors, target managers, schemas, and sink integrations.
• Expand the platform beyond Kafka-to-BigQuery by helping deliver production-ready paths to S3/GCS and Apache Iceberg, as well as transformations, deduplication, dead-letter queues, and other reusable capabilities.
• Build high-quality connectors and abstractions for systems such as Kafka, BigQuery, S3, GCS, Iceberg, Flink, and other data stores, while keeping the platform modular and easy to extend.
• Improve the self-service experience for platform users through clear APIs, safe defaults, automated provisioning, documentation, onboarding workflows, and actionable observability and alerting.
• Lead migrations from bespoke and legacy ingestion systems to the Ingestion Platform, partnering with teams such as Ads Data Platform and ML Indexing to make migrations safe, incremental, and low-touch.
• Establish strong reliability, security, and operational practices for pipelines running across Kubernetes clusters, including schema evolution, workload identity, permissions, deployment safety, monitoring, and incident response.
• Identify gaps in the platform's architecture and product experience, and lead redesigns that improve developer velocity and enable Reddit's continued growth.
• Work collaboratively with engineers and stakeholders across Infrastructure, Data Platform, Product, Ads, ML, Storage, and partner teams to align roadmaps and deliver durable solutions.

Skills

Python

Scala

Go

Java

Tools

Airflow

Kubernetes

CI/CD

Spark

Flink

Job description

Reddit is a community of communities. It's built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet's largest sources of information. For more information, visit

The Data Platform team is looking to hire a Software Engineer who is excited to solve large scale data platform and efficiency challenges. Reddit's mission is to bring community and belonging to everyone in the world. Reddit is a community of communities where people can dive into anything through experiences built around their interests, hobbies, and passions. With more than 50 million people visiting 100,000+ communities daily, it is home to the most open and authentic conversations on the internet. From pets to parenting, skincare to stocks, there's a community for everybody on Reddit. For more information, visit redditinc.com.

The Ingestion Platform team within this group is specifically responsible for empowering the business to more efficiently process data and orchestrate these data workloads.

You will:

• Design, write, and deliver reliable software for distributed data movement across streaming and batch workloads, with a focus on availability, scalability, latency, correctness, and cost efficiency.
• Contribute to the architecture and evolution of the platform's control plane and data plane, including pipeline APIs, controllers, connectors, target managers, schemas, and sink integrations.
• Expand the platform beyond Kafka-to-BigQuery by helping deliver production-ready paths to S3/GCS and Apache Iceberg, as well as transformations, deduplication, dead-letter queues, and other reusable capabilities.
• Build high-quality connectors and abstractions for systems such as Kafka, BigQuery, S3, GCS, Iceberg, Flink, and other data stores, while keeping the platform modular and easy to extend.
• Improve the self-service experience for platform users through clear APIs, safe defaults, automated provisioning, documentation, onboarding workflows, and actionable observability and alerting.
• Lead migrations from bespoke and legacy ingestion systems to the Ingestion Platform, partnering with teams such as Ads Data Platform and ML Indexing to make migrations safe, incremental, and low-touch.
• Establish strong reliability, security, and operational practices for pipelines running across Kubernetes clusters, including schema evolution, workload identity, permissions, deployment safety, monitoring, and incident response.
• Identify gaps in the platform's architecture and product experience, and lead redesigns that improve developer velocity and enable Reddit's continued growth.
• Work collaboratively with engineers and stakeholders across Infrastructure, Data Platform, Product, Ads, ML, Storage, and partner teams to align roadmaps and deliver durable solutions.

Who you might be:

• 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code
• Proficient in object-oriented programming languages like Python, Scala, Go, or Java.
• Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects.
• Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure.
• Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context.

Benefits:

• Comprehensive Healthcare Benefits and Income Replacement Programs
• 401k with Employer Match
• Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
• Family Planning Support
• Gender-Affirming Care
• Mental Health & Coaching Benefits
• Flexible Vacation & Paid Volunteer Time Off
• Generous Paid Parental Leave

Pay Transparency:

This job posting may span more than one career level. In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit

To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. The base salary range for this position is: $164,200—$229,900 USD

In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews. During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our Candidate Privacy Policy for Potential Employees and Contractors.

Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.