Software Engineer (Streaming Platform)

Sentry; United States; On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Competitive Compensation + Equity

Medical, Dental, Vision Insurance

Commuter Stipend

Professional Development Stipend

Health & Wellness Benefits

Charitable Matching Program

Flexible PTO

Paid Parental Leave

401k Plan

Job summary

Sentry is building the next generation of streaming infrastructure to power our ingestion pipelines and real-time data processing systems. The Streaming Platform team designs, builds, and operates components that scale with high throughput and low latency, including Kafka, the streaming runtime, and developer-facing abstractions.

You will work on challenges at the intersection of distributed systems, real-time data processing, and developer experience, helping engineers deploy streaming apps at

Qualifications

• Experience building and operating systems in cloud environments (Kubernetes, AWS, or GCP).
• Nice to have streaming tech: Kafka, Flink, Spark Streaming, or similar.
• Proficiency in Python, Rust, Go, or Java; primarily Python and Rust.
• At least 2–3 years of software engineering in distributed systems or real-time data.

Responsibilities

• Design, build, and operate components of the Streaming Platform, including Kafka, the streaming runtime, high-level APIs, and developer-facing abstractions.
• Implement resilient, high-throughput stream processing systems that handle unbounded datasets with strong correctness guarantees (delivery, checkpointing, watermarking, and more).
• Build scalable automation and control plane for Kafka fleet management and improve efficiency.
• Partner with product engineers to ensure our abstractions enable fast, reliable ingestion pipelines.
• Improve observability, monitoring, and failover for mission-critical real-time systems.

Skills

Distributed systems

Real-time streaming

Python

Rust

Go

Cloud environments

Kubernetes

AWS

GCP

Tools

Kafka

Flink

Spark Streaming

Job description

• The Streaming Platform team at Sentry is building the next generation of infrastructure that powers our ingestion pipelines and real-time data processing systems
• Our platform ingests, processes, and distributes hundreds of thousands of events per second with low latency and high reliability
• We are creating a system that makes it easy for Sentry engineers to deploy and run Streaming Applications at scale by simplifying the complexity of Kafka, scaling consumers automatically, and managing state so product teams can focus on building great experiences for developers
• As part of this team, you will work on challenges at the intersection of distributed systems, real-time data processing, and developer experience
• You will help us create a self-service streaming platform that improves stability, accelerates time to production, and reduces operational overhead
• Design, build, and operate components of our Streaming Platform, including Kafka, the streaming runtime, high-level APIs, and developer-facing abstractions
• Implement resilient, high-throughput stream processing systems that handle unbounded datasets with strong correctness guarantees (delivery, checkpointing, watermarking, and more)
• Build scalable automation and control plane for Kafka fleet management and improve efficiency
• Partner with product engineers to ensure our abstractions enable fast, reliable, and consistent ingestion pipelines
• Improve observability, monitoring, and failover for mission-critical real-time systems

Benefits

• Competitive Compensation + Equity
• Medical, Dental, Vision Insurance
• Commuter Stipend
• Professional Development Stipend
• Health & Wellness Benefits
• Charitable Matching Program
• Flexible PTO
• Paid Parental Leave
• 401k Plan

Experience building and operating systems in cloud environments such as Kubernetes, AWS, or GCPNice to have: experience with streaming technologies such as Kafka, Flink, Spark Streaming, or similar toolsProficiency in a programming language such as Python, Rust, Go, or Java (we primarily use Python and Rust, but experience in similar languages is valuable)At least 2-3 years of software engineering experience, with background in distributed systems, data infrastructure, or real-time streaming