Senior Big Data Engineer - Scalable Data Pipelines

Bitsight; Boston (MA); Remote; USD 135,000 - 150,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) plan

Parental leave

Job summary

Bitsight is seeking a Senior Software Engineer (Big Data) to help scale its data pipeline on AWS, ingesting security intelligence and delivering ratings for millions of organizations. You will work across data engineering, data science, and product teams, building reliable, scalable pipelines and contributing to the rating algorithm.

The role is remote (US) with prefered locations in Boston/Raleigh and offers strong benefits and a culture of innovation.

Qualifications

• Strong proficiency in modern Java language programming.
• Experience with large-scale data pipelines and distributed systems.
• Familiarity with Hadoop/Spark ecosystems and data lakehouse tech (Iceberg).
• Experience with CI/CD and Kubernetes in production.
• Knowledge of search technologies (Elasticsearch/OpenSearch) is a plus.

Responsibilities

• Build and operate large-scale data pipelines for the Bitsight data platform.
• Collaborate with data science and engineering teams to surface insights and improve the rating algorithm.
• Contribute to scalable, reliable AWS-based data infrastructure and tooling.

Skills

Java

Python

Big Data

Distributed systems

CI/CD

Kubernetes

Tools

Hadoop

Spark

Iceberg

Elasticsearch

Kubernetes

Job description

Bitsight is seeking a Senior Software Engineer (Big Data) to help scale its data pipeline on AWS, ingesting security intelligence and delivering ratings for millions of organizations. You will work across data engineering, data science, and product teams, building reliable, scalable pipelines and contributing to the rating algorithm.

The role is remote (US) with prefered locations in Boston/Raleigh and offers strong benefits and a culture of innovation.