Senior Software Engineer (Big Data)

Bitsight; Boston (MA); Remote; USD 135,000 - 150,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) plan

Parental leave

Job summary

Bitsight is seeking a Senior Software Engineer (Big Data) to help scale its data pipeline on AWS, ingesting security intelligence and delivering ratings for millions of organizations. You will work across data engineering, data science, and product teams, building reliable, scalable pipelines and contributing to the rating algorithm.

The role is remote (US) with prefered locations in Boston/Raleigh and offers strong benefits and a culture of innovation.

Qualifications

• Strong proficiency in modern Java language programming.
• Experience with large-scale data pipelines and distributed systems.
• Familiarity with Hadoop/Spark ecosystems and data lakehouse tech (Iceberg).
• Experience with CI/CD and Kubernetes in production.
• Knowledge of search technologies (Elasticsearch/OpenSearch) is a plus.

Responsibilities

• Build and operate large-scale data pipelines for the Bitsight data platform.
• Collaborate with data science and engineering teams to surface insights and improve the rating algorithm.
• Contribute to scalable, reliable AWS-based data infrastructure and tooling.

Skills

Java

Python

Big Data

Distributed systems

CI/CD

Kubernetes

Tools

Hadoop

Spark

Iceberg

Elasticsearch

Kubernetes

Job description

Bitsight is a cyber risk management leader transforming how companies manage exposure, performance, and risk for themselves and their third parties. Companies rely on Bitsight to prioritize their cybersecurity investments, build greater trust within their ecosystem, and reduce their chances of financial loss.Built on over a decade of technological innovation, its integrated solutions deliver value across enterprise security performance, digital supply chains, cyber insurance, and data analysis.We invented the cyber ratings industry in 2011Over 3500 customers trust BitsightOver 600 teammates are dispersed throughout Boston, Raleigh, New York, Lisbon, Singapore, and remotePosition: Senior Software Engineer (Big Data)Location: Remote - US Only (Preferred: Boston or Raleigh)About the role:Bitsight is looking for an experienced Big Data Engineer to join our engineering team. We pride ourselves in building exceptional career opportunities and offering outstanding benefits to our team. We have the enthusiasm of a start-up but the structure and solidity of a mature industry leader.Bitsight’s mission is to make the online world a safer place by helping governments, companies and NGOs understand and mitigate their cybersecurity risks. Ours is an internet-scale challenge - we track every IP address, every piece of malware, and a good portion of the world’s internet traffic.Bitsight’s data pipeline is the core of our Security Ratings product. We ingest security-related intelligence data from many sources, feed terabytes of data into a proprietary rating algorithm, and deliver ratings for over 1,000,000 organizations on a daily basis. Built on the highly scalable AWS ecosystem, our pipeline code base meets the highest standards of reliability and scalability to deliver consistent, actionable, intuitive, and responsive ratings to the customer.We are looking for developers with a passion for building software to collect, aggregate, and analyze data at scale using continuous, incremental development methodologies. Working with a close-knit team across multiple locations, you will help us architect and evolve the pipeline to support even larger volumes via cloud data warehouses. You will bring actionable security insights to the customer through integrating new data sources, surfacing new features from existing data, and refining the rating algorithm. Collaborating with data science and research teams, you will build trust with Bitsight customers in the quality and integrity of our data.Apart from domain skills, what we truly value are strong generalists: those with the critical thinking skills to use a variety of technologies and languages and pick up new concepts when needed. Strong collaboration skills are a must. We offer an opportunity to make a unique impact, not just as an individual but on the entire engineering team.What We're Looking For:Prior experience building and operating large-scale data pipelinesStrong proficiency in modern Java language programmingStrong computer science fundamentals in design, data structures, and algorithmsExperience working with a team of engineers, designers, and product owners in delivering a product to end-usersExcellent (English) written and verbal communication skillsPreferred Skills:Experience with PythonExperience with Hadoop, Spark ecosystemsExperience with Data Lakehouse tech stack (e.g., Apache Iceberg)Experience with Elasticsearch or OpenSearchExperience with CI/CD and KubernetesExperience with modern AI development tools (e.g., GitHub Copilot, Cursor, or LLMs)Experience working in the IT security domainBelonging & Inclusion. Bitsight is proud to be an equal opportunity employer. This means we do not tolerate discrimination of any kind and are committed to providing equal employment opportunities regardless of your gender identity, race, nationality, religion, sexual orientation, status as a protected veteran, or status as an individual with a disability.Culture. We put our people first. Bitsight offers best in class benefits. We devote the same energy to nurturing our company's inclusive culture as we apply to serving our customers' needs. Working at Bitsight will give you the opportunity to fulfill your professional goals and expand your skills.Open-minded. If you got to this point, we hope you’re feeling excited about the job description you just read. Even if you don’t feel that you meet every single requirement, we still encourage you to apply. We’re eager to meet people that believe in Bitsight’s mission and can contribute to our team in a variety of ways.Bitsight also provides reasonable accommodations to qualified individuals with disabilities or based on a sincerely held religious belief in accordance with applicable laws. If you need to inquire about a reasonable accommodation, or need assistance with completing the application process, please email [e-mail]. This contact information is for accommodation requests only, and cannot be used to inquire about the status of applications.This role uses AI-assisted transcription during the interview process. All hiring decisions are made by our recruitment team.Additional Information for United States of America Applicants:Bitsight is committed to compliance with all fair employment practices regarding citizenship and immigration status.Bitsight will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.Qualified applicants with criminal histories will be considered for employment consistent with applicable law.This position may be considered a promotional opportunity pursuant to the Colorado Equal Pay for Equal Work Act.The anticipated hiring base salary range for this position is US$135,000 to $150,000 annually for US-based employees. This range reflects the minimum and maximum target for new hire salaries for the position across all US locations, is based on a full-time work schedule, and is Bitsight’s good faith estimate as of the date of this posting. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.In addition to base salary, this role is eligible for participation in a bonus or commission plan and an equity grant. Bitsight also offers a competitive benefits package, including but not but limited to medical, dental, and vision insurance; paid parental leave; flexible time off; a 401(k) plan with employee and company contribution opportunities; life and disability insurance; and tuition reimbursement.