Streaming Platform Engineer — Real-Time Data Infra

Sentry; San Francisco (CA); Hybrid; USD 155,000 - 190,000; Full time

Benefits offered by this job

Commuter Stipend

Professional Development Stipend

Flexible PTO

Charitable Matching Program

Job summary

Sentry in San Francisco is looking for a Software Engineer to join the Streaming Platform team. Design, build, and operate components for ingestion pipelines and real-time data processing at scale.

You will work on resilient, high-throughput streaming systems, Kafka fleet management, and developer-facing abstractions to enable fast, reliable ingestion pipelines. Collaboration with product engineers and focus on observability will be essential.

Qualifications

• 2–3 years of software engineering experience, with background in distributed systems, data infrastructure, or real-time streaming.
• Proficiency in a programming language such as Python, Rust, Go, or Java (we primarily use Python and Rust, but experience in similar languages is valuable).
• Experience building and operating systems in cloud environments such as Kubernetes, AWS, or GCP.
• Nice to have: experience with streaming technologies such as Kafka, Flink, Spark Streaming, or similar tools.

Responsibilities

• Design, build, and operate components of our Streaming Platform, including Kafka, the streaming runtime, high-level APIs, and developer-facing abstractions.
• Implement resilient, high-throughput stream processing systems that handle unbounded datasets with strong correctness guarantees (delivery, checkpointing, watermarking, and more).
• Build scalable automation and control plane for Kafka fleet management and improve efficiency.
• Partner with product engineers to ensure our abstractions enable fast, reliable, and consistent ingestion pipelines.
• Improve observability, monitoring, and failover for mission-critical real-time systems.

Skills

Distributed systems

Real-time streaming

Python

Rust

Go

Java

Tools

Kubernetes

AWS

GCP

Job description

Sentry in San Francisco is looking for a Software Engineer to join the Streaming Platform team. Design, build, and operate components for ingestion pipelines and real-time data processing at scale.

You will work on resilient, high-throughput streaming systems, Kafka fleet management, and developer-facing abstractions to enable fast, reliable ingestion pipelines. Collaboration with product engineers and focus on observability will be essential.