Data Movement Platform Engineer - Scale Data Pipelines

Reddit, Inc.; Los Angeles (CA); On-site; USD 164,200 - 229,900; Full time

Benefits offered by this job

Comprehensive Healthcare Benefits

401k with Employer Match

Global Benefits Programs

Family Planning Support

Mental Health & Coaching Benefits

Flexible Vacation & Paid VolunteerTime

Job summary

Reddit, Inc. is hiring a Software Engineer for the Data Movement team to build and scale the data platform that powers ML, analytics, and business insights across hundreds of millions of users.

You will own the Data Movement Platform, work with Spark, Flink, Airflow, and cloud services, and ship self-serve, reliable data tools for internal teams.

We offer remote-friendly roles, competitive compensation, equity, and comprehensive benefits.

Qualifications

• 2+ years of software engineering experience in a production setting writing clean, maintainable, and well-tested code.
• Proficient in object-oriented programming languages like Python, Scala, Go, or Java.
• Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects.
• Experience working with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink and/or working with modern cloud-based infrastructure.
• Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context.

Responsibilities

• Refine and maintain our data infrastructure technologies to support ML and analytics workflows on data collected from hundreds of millions of users.
• Own the Data Movement Platform used to enable batch and stream data processing at Reddit.
• Invest in building new infrastructure for Spark, Flink, and Airflow technologies at Reddit, including contributing to the open source community as needed.
• Build automated solutions to minimize toilsome work for data users at Reddit and provide a declarative, self-service experience for working with data.
• Collaborate with teammates to share on-call responsibilities and support monitoring/alerting to improve the reliability, scalability, latency, and efficiency of Reddit's Data Platform.

Skills

Python

Scala

Go

Java

OO design

Tools

Airflow

Kubernetes

Spark

Flink

CI/CD

Job description

Reddit, Inc. is hiring a Software Engineer for the Data Movement team to build and scale the data platform that powers ML, analytics, and business insights across hundreds of millions of users.

You will own the Data Movement Platform, work with Spark, Flink, Airflow, and cloud services, and ship self-serve, reliable data tools for internal teams.

We offer remote-friendly roles, competitive compensation, equity, and comprehensive benefits.