Real-Time Data Engineer (Java/Storm) – TS/SCI

Stanley Reid & Company; Annapolis (MD); Hybrid; USD 90,000 - 130,000; Full time

Benefits offered by this job

401k contribution

Job summary

Stanley Reid & Company is seeking a Software Engineer to develop and maintain scalable, real-time ETL pipelines using Apache Storm and Java, processing large-scale data streams and turning raw data into actionable insights.

The role involves delivering high performance, availability, and reliability of data feeds, with full software development lifecycle responsibilities including debugging, integrating, and testing software components.

Qualifications

• Bachelor’s degree in Computer Science or a related discipline and two (2) years of experience as a Software Engineer, OR a Master’s degree in a related discipline, OR four (4) years of experience as a Software Engineer.
• Experience with the Linux CLI and scripting with Bash/Python.
• Recent software development experience with Java in a Linux environment.
• Familiarity with real-time streaming concepts, distributed computing fundamentals, and big data ecosystems such as Apache Storm, Apache Flink, Apache Spark, or Apache NiFi.
• Experience with CI/CD principles and tools like GitLab CI.
• Experience with containerization technologies such as Docker.
• Experience with Git for version control.
• Experience with the Atlassian Tool Suite (JIRA, Confluence) is a plus.

Responsibilities

• Software Engineer to develop and maintain scalable, real-time ETL pipelines.
• Use Apache Storm and Java to process large-scale data streams and transform raw data into actionable insights.
• Work as part of a team responsible for ensuring high performance, availability, and reliability of the organization’s data feeds.
• Involved in the full software development lifecycle, including debugging, integrating, and testing software components.

Skills

CI/CD concepts

Real-time streaming concepts

Distributed computing fundamentals

Team collaboration

Education

Bachelor’s degree in Computer Science or related discipline

Master’s degree in related discipline

Four years of Software Engineer experience

Tools

Linux CLI

Bash

Python

Java

Apache Storm

Apache Flink

Apache Spark

Apache NiFi

GitLab CI

Docker

Git

JIRA

Confluence

Job description

Stanley Reid & Company is seeking a Software Engineer to develop and maintain scalable, real-time ETL pipelines using Apache Storm and Java, processing large-scale data streams and turning raw data into actionable insights.

The role involves delivering high performance, availability, and reliability of data feeds, with full software development lifecycle responsibilities including debugging, integrating, and testing software components.