Engineering Manager, Data Streaming

horizon3ai

United States

Hybrid

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Stock options
Health coverage
Vision coverage
Dental coverage
Flexible vacation
Parental leave

Job summary

horizon3ai is seeking a data-streaming engineering lead to guide a sub-team responsible for collecting, normalizing, and routing telemetry from automated security assessments. You will own ingestion throughput, latency, and data quality while growing a team of 6–7 engineers.

The role focuses on reliable pipelines, scalable engineering, and collaboration with research and platform teams. Remote or hybrid work options apply depending on location and role.

Qualifications

  • Experience leading teams of 5–8 engineers building and operating production ingestion or ETL/ELT pipelines.
  • Deep knowledge of streaming or event-driven architectures such as Kafka, Kinesis, or Pub/Sub.
  • Experience designing large-scale normalization and enrichment, with attention to data quality, deduplication, and schema evolution.
  • Track record defining and owning pipeline SLOs for latency, throughput, error rates, and data completeness.
  • Experience operating cloud-native data pipelines and understanding their production failure modes.
  • Proficiency in Go or Python, plus experience with message queues, relational databases such as PostgreSQL, and Kubernetes-based services in AWS or an equivalent cloud environment.

Responsibilities

  • Guide the team's engineering execution, health, sprint cadence, technical reviews, and quality practices.
  • Own service-level objectives for ingestion throughput, latency, and errors, and establish on-call processes and runbooks.
  • Maintain stable schemas and data contracts between data producers and downstream platform teams as capabilities evolve.
  • Scale pipelines for more customers, larger environments, and new data types without a matching increase in operational effort.
  • Coordinate with research, database, and asset-inventory teams on pipeline design and data quality.
  • Build the team and promote operational ownership of production reliability.

Skills

Team leadership
Streaming architectures
Data pipelines
SLOs ownership
Go or Python

Tools

Kafka
Kinesis
Pub/Sub
PostgreSQL
Kubernetes
AWS

Job description

Role overview

Lead a data-streaming sub-team responsible for collecting, normalizing, and routing telemetry from automated security assessments. The pipelines turn raw discoveries—such as assets, vulnerabilities, and relationships—into usable customer insights, so the role centers on operational reliability, scalable engineering, and team growth. The team is expected to grow to six or seven engineers.

Responsibilities
  • Guide the team's engineering execution, health, sprint cadence, technical reviews, and quality practices.
  • Own service-level objectives for ingestion throughput, latency, and errors, and establish on-call processes and runbooks.
  • Maintain stable schemas and data contracts between data producers and downstream platform teams as capabilities evolve.
  • Scale pipelines for more customers, larger environments, and new data types without a matching increase in operational effort.
  • Coordinate with research, database, and asset-inventory teams on pipeline design and data quality.
  • Build the team and promote operational ownership of production reliability.
Requirements
  • Experience leading teams of 5–8 engineers building and operating production ingestion or ETL/ELT pipelines.
  • Deep knowledge of streaming or event-driven architectures such as Kafka, Kinesis, or Pub/Sub.
  • Experience designing large-scale normalization and enrichment, with attention to data quality, deduplication, and schema evolution.
  • Track record defining and owning pipeline SLOs for latency, throughput, error rates, and data completeness.
  • Experience operating cloud-native data pipelines and understanding their production failure modes.
  • Proficiency in Go or Python, plus experience with message queues, relational databases such as PostgreSQL, and Kubernetes-based services in AWS or an equivalent cloud environment.
Benefits and work setup
  • Stock options.
  • Health coverage.
  • Vision coverage.
  • Dental coverage.
  • Flexible vacation.
  • Parental leave.

Work may be remote or hybrid depending on role and location.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager, Data Streaming & Reliability (Remote)
Engineering Manager, Data Streaming & Reliability (Remote)

horizon3ai • United States

Hybrid
USD 180,000 - 260,000
Stock options
Health coverage
Vision coverage
+3
Sr. Data Engineer (Remote)
Sr. Data Engineer (Remote)

modemobile • United States

Remote
USD 160,000 - 260,000
Company equity
Performance bonus
Open PTO
+3
Lead Software Engineer – Real-Time Events
Lead Software Engineer – Real-Time Events

zetaglobal • United States

Remote
USD 180,000 - 240,000
Flexible PTO
Medical, dental, and vision coverage
Employee equity
+3
Scala Data Engineer — Real-Time Streaming Pipelines
Scala Data Engineer — Real-Time Streaming Pipelines

Compunnel Inc. • Greenwood Village (CO)

On-site
USD 90,000 - 130,000
Senior Data Engineer, Event Data
Senior Data Engineer, Event Data

movableink • United States

Remote
USD 102,000 - 130,000
Medical benefits
Financial benefits
Bonus potential
Staff Data Engineer
Staff Data Engineer

Vertexinc • United States

Remote
USD 150,000 - 190,000
Software Engineer Data Platform
Software Engineer Data Platform

Cato Networks • United States

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Continuus Technologies LLC • Town of Germantown (WI)

On-site
USD 110,000 - 170,000
Staff Data Engineer
Staff Data Engineer

robotsandpencils • United States

Remote
USD 130,000 - 190,000
Data Engineer (FedD024)
Data Engineer (FedD024)

defenseunicorns • United States

Remote
USD 149,000 - 201,000
Health, dental, vision premiums fully
HSA benefits
Stock options
+5