Senior Streaming Platform Engineer – Real-time Data (Equity, Bonus)

Auth21; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Equity

Bonus

Paid Time Off

Group Health Insurance

Job summary

Auth21 is seeking a skilled software engineer to design and operate a self-service streaming platform powering ingestion pipelines and real-time data processing in a distributed environment. You will build resilient, high-throughput systems and scalable automation to manage Kafka fleets, improving developer experience.

Ideal candidates have 5+ years in distributed systems or real-time streaming and strong proficiency in Python, Rust, Go, or Java, with hands-on experience in Kubernetes and cloud

Qualifications

• 5+ years of experience in distributed systems or real-time streaming.
• Proficiency in Python, Rust, Go, or Java.
• Experience with cloud environments and Kubernetes, AWS, or GCP.

Responsibilities

• Design and operate a self-service streaming platform for ingestion pipelines and real-time processing.
• Build resilient, high-throughput distributed systems and scalable automation for Kafka fleet management.
• Improve developer experience through robust platform tooling.

Skills

Distributed Systems

Kafka

Python

Rust

Go

Java

Flink

Spark Streaming

Kubernetes

AWS

GCP

Real-time Data Processing

Stream Processing

API Design

Observability

Control Plane Management

Job description

Auth21 is seeking a skilled software engineer to design and operate a self-service streaming platform powering ingestion pipelines and real-time data processing in a distributed environment. You will build resilient, high-throughput systems and scalable automation to manage Kafka fleets, improving developer experience.

Ideal candidates have 5+ years in distributed systems or real-time streaming and strong proficiency in Python, Rust, Go, or Java, with hands-on experience in Kubernetes and cloud