Software Engineer

District 4 Labs; Illinois; On-site; USD 80,000 - 120,000; Full time

Job summary

District 4 Labs in Illinois is seeking a Software Engineer to design and maintain their open-source intelligence tools. This role is pivotal in developing APIs and optimizing data structures for efficient access to dark web datasets.

The ideal candidate exhibits strong skills in Elasticsearch and Python, collaborates with cross-functional teams, and understands data privacy. A degree in Computer Science or related field is beneficial.

Qualifications

• Proficiency in working with large-scale data processing frameworks.
• Experience with API development and management.
• Strong programming skills in Python.

Responsibilities

• Parse new deep and dark web data sets for integration.
• Develop and maintain API endpoints for querying data.
• Collaborate with teams to optimize search algorithms.

Skills

Data processing frameworks

Elasticsearch

Open-source intelligence (OSINT)

API development

Python

Cloud platforms

Communication

Education

Bachelor's or Master's degree in Computer Science

Job description

Overview

District 4 Labs ("District 4" or "D4") is a cutting‑edge data business dedicated to building the open‑source intelligence (OSINT) tools and technologies of tomorrow. Its flagship product, DARKSIDE, is one of the world’s largest repositories of breached data, compromised records, and other person of interest information. DARKSIDE was built by investigators for investigators and is critical for any online investigation or intelligence gathering exercise, especially those involving attribution and online account identification.

Position Summary

Software Engineers play a critical role in designing, building, and maintaining our in‑house dark web and open‑source data repositories, search applications, and APIs. They will also work closely with a cross‑functional team to improve and maintain the reliability, scalability, and performance of these tools and technologies. Expertise in data ingestion and parsing is especially sought after.

Essential Job Functions

• Parse new deep and dark web data sets ahead of addition to DARKSIDE.
• Develop and maintain API endpoints for querying dark web data, ensuring efficient and reliable access to our systems.
• Identify and integrate optimal database solutions.
• Collaborate with other engineers and DevOps teams to optimize search algorithms and improve search relevance.
• Work with client‑facing team members to understand customer requirements and translate them into technical specifications for enhancements.
• Stay up to date with industry trends and best practices in search technologies and API management to drive innovation and improvement.
• Work with internal and external stakeholders to optimize data infrastructure and identify cost savings, where possible.

Competencies

• Proficiency in working with large‑scale data processing frameworks, especially Elasticsearch.
• Familiarity with open-source intelligence (OSINT) and/or dark web intelligence collection and/or processes.
• Experience with API development and management, including authentication, versioning, and performance optimization.
• Proven experience as an engineer, preferably in the development and management of search engines and APIs.
• Demonstrated knowledge of cloud platforms, especially AWS and Azure.
• Excellent communication and collaboration skills to work effectively in a cross‑functional team environment.
• Knowledge of data privacy and security considerations when working with sensitive data.
• Strong programming skills in Python.

Education & Experience Requirements

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions. While not required, candidates typically have a Bachelor's or Master's degree in Computer Science, Data Science, or a related field.

District 4 provides equal employment opportunities to all employees and applicants.

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.