Data Streaming Engineering Manager - Scale & Reliability

OpenKrill; United States; Remote; USD 225,000 - 265,000; Full time

Benefits offered by this job

Inclusive Team

Growth Opportunities

Innovative Culture

Hybrid & Remote Work

Competitive Compensation

Job summary

Horizon3 is seeking a Lead Data Streaming Engineer to guide the Data Streaming sub-team within Data Ingestion. You will drive design and delivery of reliable ingestion pipelines powering NodeZero’s autonomous pentests, partnering with Security Research and Database Platform.

You will grow the team to 6–7 engineers, ensuring scalable, observable pipelines with strong data quality and governance across environments.

Qualifications

• Experience leading data ingestion pipelines in production.
• Strong understanding of streaming architectures (Kafka/Kinesis/Pub/Sub).
• Proven ability to define and own SLOs for pipeline systems.

Responsibilities

• Lead Data Streaming: own engineering execution and team health for the Data Streaming sub-team.
• Drive sprint cadence, design reviews, and engineering quality for high-throughput pipelines.
• Own SLOs for ingestion throughput, latency, and error rates; implement on-call processes.

Skills

Team leadership

Data streaming pipelines

SLO definition

Cloud-native ops

Go or Python

Education

BS in Computer Science or related

Tools

Kafka

Kinesis

RabbitMQ

PostgreSQL

Kubernetes

Job description

Horizon3 is seeking a Lead Data Streaming Engineer to guide the Data Streaming sub-team within Data Ingestion. You will drive design and delivery of reliable ingestion pipelines powering NodeZero’s autonomous pentests, partnering with Security Research and Database Platform.

You will grow the team to 6–7 engineers, ensuring scalable, observable pipelines with strong data quality and governance across environments.