Senior Integrations Engineer: Data Pipelines & Scoring

HeroDevs, Inc.; United States; Remote; USD 135,000 - 180,000; Full time

Job summary

HeroDevs, Inc. is seeking a Senior Software Engineer to help advance the Evergreen team and scale EOLDS data assets for partners.

You will own design choices, set patterns for the team, and collaborate with partner-facing groups to translate requirements into robust data processing and scoring models. You’ll build pipelines that generate and publish large numbers of packages on demand, integrate with Kafka and data lake, and contribute to monitoring, testing, and documentation to ensure

Qualifications

• 5+ years of professional software engineering experience building data-intensive systems or data pipelines.
• Proficiency in TypeScript/JavaScript (Node.js).
• Experience with Kafka and data lakes/warehouses.
• Strong SQL and data modeling skills.
• Experience designing data validation and data quality checks.
• Comfort with scoring/ranking/heuristic systems and tradeoffs.
• Experience with CI/CD pipelines and automation.
• Ability to understand unfamiliar systems and document them clearly.
• Strong written communication and ability to drive decisions in a distributed team.
• Bachelor’s degree in CS or related field or equivalent experience.
• Experience with git-based development (GitHub preferred).

Responsibilities

• Improve EOLDS data quality through validation, deduplication, provenance tracking, and automated checks.
• Investigate and document risk heuristics inputs, assumptions, and edge cases.
• Design a multi-model risk scoring framework for remediation, including CVE-centric models.
• Build weighted, configurable scoring for partner-specific use cases with explanations of scores.
• Integrate EOLDS with Kafka and data lake; define event schemas, producers, and consumers.
• Create automated pipelines to generate, version, and publish large numbers of packages.
• Add monitoring and data quality metrics for datasets, scoring, or package delivery.
• Translate partner requirements into data and scoring changes.
• Write TypeScript/Node.js services with automated tests and CI/CD.
• Review code, mentor engineers, and raise engineering bar.
• Document datasets, scoring models, and pipelines.

Skills

TypeScript/JavaScript

Distributed systems

Data pipelines

SQL

CI/CD

GitHub

Written communication

Education

Bachelor’s degree in Computer Science or related field

Tools

Kafka

Data lake

GitHub

Avro/Protobuf

Job description

HeroDevs, Inc. is seeking a Senior Software Engineer to help advance the Evergreen team and scale EOLDS data assets for partners.

You will own design choices, set patterns for the team, and collaborate with partner-facing groups to translate requirements into robust data processing and scoring models. You’ll build pipelines that generate and publish large numbers of packages on demand, integrate with Kafka and data lake, and contribute to monitoring, testing, and documentation to ensure