Senior Big Data Engineer – Remote, Scalable Pipelines

Bitsight; United States; Remoto; USD 135.000 - 150.000; Tempo pieno

Descrizione del lavoro

Bitsight is seeking a Senior Software Engineer (Big Data) to join our remote US team. You will work on ingesting security-related intelligence, building scalable data pipelines, and delivering ratings for millions of organizations using a cloud-first AWS-based architecture.

You’ll collaborate with data scientists and researchers, bring in new data sources, and refine the rating algorithm to provide reliable security insights for customers worldwide.

Competenze

• Experience building and operating large-scale data pipelines.
• Strong Java programming skills and CS fundamentals.
• Experience collaborating with engineers, designers, and product owners.
• Excellent written and verbal English communication.

Mansioni

• Help architect and evolve data pipelines to scale with more data.
• Integrate new data sources and surface new features from existing data.
• Collaborate with data science and research teams to ensure data quality.

Conoscenze

Large-scale pipelines

Java programming

CS fundamentals

Team collaboration

English communication

Python

Hadoop

Spark

Iceberg

Elasticsearch/OpenSearch

CI/CD

Kubernetes

AI development tools

IT security domain

Strumenti

Hadoop ecosystem

Spark ecosystem

Apache Iceberg

Elasticsearch/OpenSearch

CI/CD tooling

Kubernetes tooling

Descrizione del lavoro

Bitsight is seeking a Senior Software Engineer (Big Data) to join our remote US team. You will work on ingesting security-related intelligence, building scalable data pipelines, and delivering ratings for millions of organizations using a cloud-first AWS-based architecture.

You’ll collaborate with data scientists and researchers, bring in new data sources, and refine the rating algorithm to provide reliable security insights for customers worldwide.