Remote Senior Big Data Engineer: Scale Pipelines

Cacheflow; United States; Remote; USD 135,000 - 150,000; Full time

Benefits offered by this job

Equity grant

Medical, dental, vision insurance

Job summary

Bitsight is seeking a Senior Software Engineer (Big Data) to join our team in a remote US-based role. You will contribute to our data pipeline that ingests security intelligence and delivers ratings for millions of organizations daily.

You’ll work across data engineering, data science, and product teams to expand capabilities in a scalable AWS-based environment. The role emphasizes building software to collect, aggregate, and analyze data at scale, using Java and big data frameworks.

Qualifications

• Experience building and operating large-scale data pipelines.
• Strong proficiency in modern Java.
• Solid CS fundamentals in design, data structures, and algorithms.

Responsibilities

• Architect and evolve data pipelines to support larger volumes in cloud data warehouses.
• Collaborate with data science and research teams to surface new features from data.
• Deliver reliable, scalable, and actionable ratings to customers.

Skills

Java

Big Data

Data pipelines

Team collaboration

English communication

Python

CS fundamentals

Cloud/AWS

Tools

Hadoop

Spark

Apache Iceberg

Elasticsearch/OpenSearch

CI/CD

Kubernetes

Data Lakehouse

GitHub Copilot/AI tools

Job description

Bitsight is seeking a Senior Software Engineer (Big Data) to join our team in a remote US-based role. You will contribute to our data pipeline that ingests security intelligence and delivers ratings for millions of organizations daily.

You’ll work across data engineering, data science, and product teams to expand capabilities in a scalable AWS-based environment. The role emphasizes building software to collect, aggregate, and analyze data at scale, using Java and big data frameworks.