Engineering Manager, Data Streaming

OpenKrill; United States; Remote; USD 225,000 - 265,000; Full time

Benefits offered by this job

Inclusive Team

Growth Opportunities

Innovative Culture

Hybrid & Remote Work

Competitive Compensation

Job summary

Horizon3 is seeking a Lead Data Streaming Engineer to guide the Data Streaming sub-team within Data Ingestion. You will drive design and delivery of reliable ingestion pipelines powering NodeZero’s autonomous pentests, partnering with Security Research and Database Platform.

You will grow the team to 6–7 engineers, ensuring scalable, observable pipelines with strong data quality and governance across environments.

Qualifications

• Experience leading data ingestion pipelines in production.
• Strong understanding of streaming architectures (Kafka/Kinesis/Pub/Sub).
• Proven ability to define and own SLOs for pipeline systems.

Responsibilities

• Lead Data Streaming: own engineering execution and team health for the Data Streaming sub-team.
• Drive sprint cadence, design reviews, and engineering quality for high-throughput pipelines.
• Own SLOs for ingestion throughput, latency, and error rates; implement on-call processes.

Skills

Team leadership

Data streaming pipelines

SLO definition

Cloud-native ops

Go or Python

Education

BS in Computer Science or related

Tools

Kafka

Kinesis

RabbitMQ

PostgreSQL

Kubernetes

Job description

Get to Know Us

Horizon3 is a fast-growing, remote cybersecurity company dedicated to the mission of enabling organizations to proactively find and fix and verify exploitable attack vectors before criminals exploit them. Our flagship product, the NodeZeroTM platform, delivers production-safe autonomous pentests and other key assessment operations that scale across the largest internal, external, cloud, and hybrid cloud environments. NodeZero has been adopted by organizations of all sizes, from small educational institutions to government agencies and Global 100 enterprises. It is used by ITOps/SecOps teams, consulting pentesters, and MSSPs and MSPs.

We are a fusion of former U.S. Special Operations cyber operators, startup engineers, and formerly frustrated cybersecurity practitioners. We're committed to helping solve our common security problems: ineffective security tools, false positives resulting in alert fatigue, blind spots, "checkbox” security culture, cybersecurity skills shortage, and the long lead time and expense of hiring outside consultants. Collectively, we are a team of learn it alls, committed to a culture of respect, collaboration, ownership, and results.

What You'll Do

You will lead Data Streaming — a sub-team within Data Ingestion, reporting to the Senior Manager, Data Ingestion. Data Streaming is the team responsible for reliably collecting, normalizing, and routing the raw data that powers NodeZero's autonomous pentests. Every IP address, open port, credential, vulnerability finding, and asset relationship that NodeZero discovers flows through this team's pipelines before it becomes an insight the customer can act on. Data Streaming is mission-critical: if the pipeline stalls, pentest results stall. You will grow this sub-team from its current state to a full team of 6–7 engineers, building the reliability and throughput to match NodeZero's growth trajectory.

• Lead Data Streaming: Own the engineering execution and team health for the Data Streaming sub-team. Drive sprint cadence, technical design reviews, and engineering quality for a team that processes pentest telemetry at scale.
• Pipeline Reliability: Own SLOs for ingestion throughput, latency, and error rates. Build the on-call processes and runbooks that keep pipelines healthy in production.
• Schema & Contract Ownership: Maintain stable ingestion schemas and data contracts between the NodeZero runner, Security Research, and the Database Platform. Evolve these contracts carefully as new pentest capabilities ship.
• Scalability: Scale ingestion pipelines to handle NodeZero's growth — more customers, larger environments, new data types — without requiring proportional engineering effort to operate.
• Partner cross-functionally: Work closely with Security Research (the source of new pentest data), Database Platform (the downstream consumer), and Asset Inventory (which depends on clean, normalized data) to align on data quality and pipeline design.
• Team Building: Grow the sub-team to full capacity and build a culture of operational ownership: engineers who are proud of pipeline reliability, not just feature velocity.

What You'll Bring

• Experience leading teams of 5-8 engineers building and operating data ingestion or ETL/ELT pipelines in production.
• Deep understanding of streaming or event-driven data architectures — Kafka, Kinesis, Pub/Sub, or equivalent.
• Experience designing data normalization and enrichment pipelines at scale, with strong attention to data quality, deduplication, and schema evolution.
• Proven ability to define and own SLOs for pipeline systems: latency, throughput, error rate, and data completeness.
• Experience operating data pipelines in cloud-native environments; understands the failure modes and operational patterns at scale.
• Comfortable operating with autonomy — can translate ambiguous product requirements into well-scoped engineering projects.

Technical Expertise

• Proficient in Go or Python; comfortable reading and writing pipeline code, not just managing those who do.
• Experience with message queues and streaming systems: Kafka, Kinesis, RabbitMQ, or equivalent.
• Experience with PostgreSQL or other relational databases as a pipeline destination.
• Kubernetes and containerized service operations in AWS or equivalent cloud.
• Familiarity with data observability tooling: pipeline monitoring, alerting, and schema drift detection.

Nice to Haves

• Exposure to cybersecurity data — network scan data, vulnerability feeds, CVE/NVD schemas, or asset inventories.
• Experience with graph data pipelines or knowledge graph construction.
• Familiarity with CDC (Change Data Capture) patterns for downstream data consumers.
• Background in data quality frameworks or data contract tooling.

Travel Required

We are a fully remote company, and this job may require up to 5% of travel to be successful.

Compensation and Values

At Horizon3, we believe that our people are our greatest asset, and our compensation philosophy reflects this core value. We are committed to fostering an environment where all employees feel valued, respected, and rewarded for their contributions. Our compensation structure is designed to be fair, competitive, and transparent, ensuring that every team member is recognized and compensated equitably across roles, levels, and locations.

In accordance with various State's transparency regulations, we provide the following salary range information for this position:

• Base salary range: $225,250 - $265,000 annually. The exact salary will be determined based on the selected candidate's location, qualifications, experience, and relevant skills.
• Additional compensation: This role may also be eligible for an equity package (in the form of stock options). If any other compensation benefits apply, they will be discussed during the interview process.

Perks of Horizon3

• Inclusive Team: We value diversity and promote an inclusive culture where everyone can thrive.
• Growth Opportunities: Be part of a dynamic and growing team with numerous career development opportunities.
• Innovative Culture: Work in a collaborative environment that encourages creativity and out-of-the-box thinking.
• Hybrid & Remote Work: We embrace a mix of remote and hybrid work models depending on role and location, including our Chicago office, where some roles require regular in-office presence.
• Competitive Compensation: We offer competitive salary, equity and benefits. Our benefits include health, vision & dental insurance for you and your family, a flexible vacation policy, and generous parental leave.

You Belong Here

Horizon3 is not just an equal opportunity employer - we are a community that values diversity, equity, and inclusion as fundamental principles of our culture and success. We are dedicated to fostering a workplace where everyone feels welcome and respected, regardless of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, hair length or any other legally protected status by law.

Our commitment to diversity and inclusion means we strive to attract, develop, and retain a workforce that reflects the varied communities we serve. We believe that diverse perspectives drive innovation and strengthen our ability to create cutting-edge cybersecurity solutions. At Horizon3, every team member is valued and supported in an environment that encourages personal and professional growth.

We welcome candidates from all backgrounds and experiences, and we encourage all qualified individuals to apply. Come be a part of Horizon3, where your unique contributions are recognized, and your potential is limitless.

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are require