Senior Software Engineer - Integrations & Data Pipelines

HeroDevs, Inc.; Salt Lake City (UT); On-site; USD 120,000 - 160,000; Full time

Job summary

HeroDevs, Inc. is seeking a Senior Software Engineer for the Evergreen team to build scalable pipelines that generate and publish large numbers of packages for partners on demand.

You will make design decisions and set patterns for the team, collaborating with partner-facing teams to understand data needs. You will implement TypeScript/Node.js services, integrate with Kafka and data lakes, and contribute to automated testing, CI/CD, and documentation.

Qualifications

• 5+ years of professional software engineering experience building data-intensive systems or data pipelines in production.
• Proficiency in TypeScript/JavaScript (Node.js).
• Experience with event streaming platforms such as Kafka, and with data lakes or data warehouses.
• Strong SQL and data modeling skills.
• Experience designing data validation and data quality checks for datasets other teams or customers depend on.
• Comfort reasoning about scoring, ranking, or heuristic systems, such as weighted models or risk scores, and explaining their tradeoffs.
• Experience building build, release, or publishing automation, including CI/CD pipelines.
• The ability to dig into an unfamiliar system, figure out how it works, and write it down so others can understand.
• Strong written communication and the ability to drive technical decisions in a distributed team.
• Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
• Experience with git-based software development (preferably on GitHub).

Responsibilities

• Improve EOLDS data quality through validation, deduplication, provenance tracking, and automated checks that catch regressions before they reach partners.
• Investigate and document how our current risk heuristics work, including their inputs, assumptions, and edge cases.
• Design and build a multi-model risk scoring framework that supports different risk profiles for remediation, including CVE-centric models alongside our existing heuristics.
• Build weighted, configurable scoring so risk profiles can be tuned per partner or use case, with clear explanations of how a score was produced.
• Integrate EOLDS with Kafka and our data lake, including event schemas, producers and consumers, backfills, and consistency between systems.
• Build automated pipelines that can generate, version, and publish large numbers of packages for partners on demand, reliably and reproducibly.
• Add monitoring and data quality metrics so problems with the dataset, scoring, or package delivery surface quickly.
• Work with product and partner-facing teams to translate partner requirements into data and scoring changes.
• Write services and tooling in TypeScript/Node.js, with automated testing and CI/CD.
• Review code and designs, mentor other engineers, and help raise the team's engineering bar.
• Write clear documentation for the dataset, scoring models, and pipelines you build.
• Work to automate package requests from our partners.

Skills

TypeScript/JS

Kafka

SQL

Data Modeling

CI/CD

GitHub

Data Pipelines

Education

Bachelor's degree in Computer Science or related field

Tools

Protobuf

Avro

OpenSearch/Elasticsearch

Job description

HeroDevs, Inc. is seeking a Senior Software Engineer for the Evergreen team to build scalable pipelines that generate and publish large numbers of packages for partners on demand.

You will make design decisions and set patterns for the team, collaborating with partner-facing teams to understand data needs. You will implement TypeScript/Node.js services, integrate with Kafka and data lakes, and contribute to automated testing, CI/CD, and documentation.