Software Engineer (Ingestion Platform)

Reddit; United States; On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Comprehensive health benefits

Flexible vacation & Reddit global days

Parental leave

Development funds

Volunteer time off

Workspace & home office benefits

Job summary

Reddit's Data Movement team is looking for a Software Engineer to design and maintain scalable data platforms that power ML and analytics across hundreds of millions of users. You will own critical components and improve throughput and reliability.

Proficiency in Python, Scala, Go, or Java, plus experience with Airflow, Kubernetes, Spark, Flink and CI/CD, is required. You will collaborate with cross-functional teams and demonstrate leadership on large, data-intensive projects.

Qualifications

• 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code.
• Proficient in object-oriented programming languages like Python, Scala, Go, or Java.
• Experience working with cloud services and modern data infrastructure is a plus.

Responsibilities

• As a software engineer, you will work with teammates and partner teams to create and improve scalable, fault tolerant, self-serve systems
• Refine and maintain our data infrastructure technologies to support ML and analytics workflows on data collected from hundreds of millions of users
• Own the Data Movement Platform used to enable batch and stream data processing at Reddit
• Invest in building new infrastructure for Spark, Flink, and Airflow technologies at Reddit, including contributing to the open source community as needed
• Build automated solutions to minimize toilsome work for data users at Reddit and provide a declarative, self-service experience for working with data
• Collaborate with teammates to share on-call responsibilities and support monitoring/alerting to improve the reliability, scalability, latency, and efficiency of Reddit’s Data Platform

Skills

Python

Scala

Go

Java

Tools

Airflow

Kubernetes

CI/CD

Spark

Flink

Job description

• As a software engineer, you will work with teammates and partner teams to create and improve scalable, fault tolerant, self-serve systems
• Refine and maintain our data infrastructure technologies to support ML and analytics workflows on data collected from hundreds of millions of users
• Own the Data Movement Platform used to enable batch and stream data processing at Reddit
• Invest in building new infrastructure for Spark, Flink, and Airflow technologies at Reddit, including contributing to the open source community as needed
• Build automated solutions to minimize toilsome work for data users at Reddit and provide a declarative, self-service experience for working with data
• Collaborate with teammates to share on-call responsibilities and support monitoring/alerting to improve the reliability, scalability, latency, and efficiency of Reddit’s Data Platform

Benefits

• Comprehensive health benefits
• Flexible vacation & Reddit global days off
• Family planning funds & 4+ months paid parental leave
• Personal & professional development funds
• Paid volunteer time off
• Workspace & home office benefits

The Data Movement team is looking to hire a Software Engineer who is excited to solve large scale data platform and efficiency challenges If you have a passion for building and maintaining high quality code, want to improve how Reddit makes strategic decisions at the company level, and are excited about applying engineering best practices to one of the most powerful corpus of data in the world, then this is the team for you! Proficient in object-oriented programming languages like Python, Scala, Go, or Java Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context