Senior Software Engineer, Streaming Platform

Auth21; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Equity

Bonus

Paid Time Off

Group Health Insurance

Job summary

Auth21 is seeking a skilled software engineer to design and operate a self-service streaming platform powering ingestion pipelines and real-time data processing in a distributed environment. You will build resilient, high-throughput systems and scalable automation to manage Kafka fleets, improving developer experience.

Ideal candidates have 5+ years in distributed systems or real-time streaming and strong proficiency in Python, Rust, Go, or Java, with hands-on experience in Kubernetes and cloud

Qualifications

• 5+ years of experience in distributed systems or real-time streaming.
• Proficiency in Python, Rust, Go, or Java.
• Experience with cloud environments and Kubernetes, AWS, or GCP.

Responsibilities

• Design and operate a self-service streaming platform for ingestion pipelines and real-time processing.
• Build resilient, high-throughput distributed systems and scalable automation for Kafka fleet management.
• Improve developer experience through robust platform tooling.

Skills

Distributed Systems

Kafka

Python

Rust

Go

Java

Flink

Spark Streaming

Kubernetes

AWS

GCP

Real-time Data Processing

Stream Processing

API Design

Observability

Control Plane Management

Job description

Design and operate a self-service streaming platform to power ingestion pipelines and real-time data processing. Build resilient, high-throughput systems and scalable automation for Kafka fleet management to improve developer experience.

Requirements:

Requires 5+ years of software engineering experience specializing in distributed systems or real-time streaming. Proficiency in Python, Rust, Go, or Java and experience with cloud environments like Kubernetes, AWS, or GCP is required.

Key Skills:

Distributed Systems, Kafka, Python, Rust, Go, Java, Flink, Spark Streaming, Kubernetes, AWS, GCP, Real-time Data Processing, Stream Processing, API Design, Observability, Control Plane Management

Benefits:

Equity, Bonus, Paid Time Off, Group Health Insurance Coverage