Data Platform Engineer — Scale & Self-Serve Workflows

Socket.dev; United States; On-site; USD 164,000 - 230,000; Full time

Benefits offered by this job

Healthcare benefits

401k with employer match

Parental leave

Mental health benefits

Job summary

Reddit is seeking a Software Engineer for the Data Movement team, offering a remote-friendly, flexible-first work environment in the United States. You will help build and optimize a data platform used for ML and analytics across hundreds of millions of users.

You will own the Data Movement Platform, advance Spark, Flink, and Airflow infrastructure, and develop self-service data tooling, while collaborating with multiple teams to improve reliability, latency, and scalability.

Qualifications

• 2+ years of software engineering in production environments.
• Proficient in OO languages: Python, Scala, Go, or Java.
• Experience with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink.
• Strong collaboration and communication skills.

Responsibilities

• Refine and maintain data infrastructure for ML and analytics workflows.
• Own the Data Movement Platform for batch and stream processing.
• Invest in building infrastructure for Spark, Flink, Airflow; contribute to OSS.
• Build automated self-service data tooling and declarative interfaces.
• Collaborate on-call responsibilities and monitoring for reliability and scalability.

Skills

Python

Scala

Go

Java

Large-scale systems design

Communication

Tools

Airflow

Kubernetes

CI/CD

Spark

Flink

Job description

Reddit is seeking a Software Engineer for the Data Movement team, offering a remote-friendly, flexible-first work environment in the United States. You will help build and optimize a data platform used for ML and analytics across hundreds of millions of users.

You will own the Data Movement Platform, advance Spark, Flink, and Airflow infrastructure, and develop self-service data tooling, while collaborating with multiple teams to improve reliability, latency, and scalability.