Lead Data Flow Engineer (Java/NiFi Focus) - PRIME, Hybrid - TS/SCI

stanleyreid; Columbia (MD); Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Fully-paid medical

4 weeks PTO

6% 401k match

Training budget > $5k

Job summary

PRIME in Columbia, MD seeks a Senior/Lead Data Flow Engineer to architect and manage large-scale data ingestion infrastructure. You will lead data acquisition and sharing efforts, modify data sources, and implement testing and monitoring while solving complex dataflow issues from ingest to visualization.

Required 14+ years in software/data engineering with strong Java and NiFi skills, plus AWS S3/SQS, Kafka, and containerized environments. TS/SCI clearance is mandatory for consideration.

Qualifications

• 14+ years of experience in software development, data engineering, or database engineering.
• Java and NiFi administration with data flow building.
• AWS S3/SQS, Kafka, Maven, GitLab experience.
• ETL design, data modeling, Linux OS (BASH) administration.
• Fluency with YAML, JSON, and XML.
• Experience with Airflow, Mage AI; Docker/Kubernetes.
• DoD IAT II or higher certification required.

Responsibilities

• Lead efforts in data acquisition, analysis, and sharing for large-scale data ingestion.
• Build and manage software infrastructure for data ingestion pipelines.
• Modify data sources, implement testing and monitoring, and troubleshoot dataflow issues.
• Act as technical lead to ensure data integrity and foster innovation.
• Address high-level technical problems from ingest to visualization.

Skills

Java

Apache NiFi

AWS S3

AWS SQS

Kafka

Maven

GitLab

ETL design

Data modeling

Linux (Bash)

JSON/YAML/XML

Airflow

Mage AI

Docker/Kubernetes

DoD IAT II

Education

Bachelor’s degree or equivalent experience

Tools

Docker

Kubernetes

Apache Airflow

Mage AI

GitLab

Job description

Lead Data Flow Engineer (Java/NiFi Focus) - PRIME, Hybrid - TS/SCI

• Columbia, MD

Our client is a woman-owned small business supporting critical missions in the IC/DoD. They specialize in cybersecurity, software development, data science, and cloud migration. Enjoy a close-knit team and exceptional benefits.

• fully-paid medical
• 4 weeks PTO
• 6% 401k match
• over $5k for training

The Role

As a Senior/Lead Data Flow Engineer, you will lead efforts in strategic data acquisition, analysis, and sharing. This role focuses on building and managing software infrastructure for large-scale big data ingestion. You will be responsible for modifying existing data sources, implementing testing/monitoring, and troubleshooting complex dataflow issues. You will act as a technical lead, ensuring data integrity and fostering innovation within the department while solving high-level technical problems from ingest to visualization.

What You'll Bring

• Experience: 14+ years of experience in software development, data engineering, or database engineering (4 additional years of experience can substitute for a degree).
• Primary Tech Stack: High proficiency in Java (including Unit/Integration testing) and significant experience with Apache NiFi administration and data flow building.
• Cloud & Tools: Experience with AWS S3 and SQS solutions, Kafka, Maven, and GitLab.
• Technical Depth: Expertise in ETL creation, data modeling design, and Linux OS (BASH) server administration.
• Data Skills: Fluency with data extraction, custom logic development, and familiarity with YAML, JSON, and XML.
• Desired Extras: Experience with Apache Airflow, Mage AI, Docker/Kubernetes, and prior cyber security operations support.
• Certifications: DoD IAT II or higher (Sec+, etc) required for consideration.

*Please note: Applicants may be required to complete a coding challenge during the interview process per customer requirements.

Clearance Requirements

An active TS/SCI is required for consideration. Please note, you must have the required clearance for consideration; under-cleared applicants will not receive a response.

Location

Columbia, MD (Hybrid)

Please Note

Due to high application volume, we are unable to confirm receipt of submissions or provide updates. We will contact you directly if there is a match. Opportunities change frequently; we cannot guarantee availability.