Systems Engineer 6 - Hadoop/Linux/NiFi/XKS/DevOps

Captivation; Maryland; On-site; USD 130,000 - 270,000; Full time

Benefits offered by this job

Up to 20% 401k contribution

Above Market Hourly Rates

$3,600 HSA Contribution

6 Weeks Paid Time Off

Company-paid medical/dental/vision insurance

Life insurance

Short-Term & Long-Term Disability Insurance

Job summary

Captivation is seeking a Principal Data Flow Engineer responsible for designing and managing enterprise-scale dataflow architectures supporting mission-critical analytics. This role involves overseeing cloud infrastructures and developing end-to-end dataflow solutions using technologies like Niagara files.

The ideal candidate will hold a Top Secret/SCI U.S. Government security clearance and possess substantial systems engineering experience. Comprehensive benefits include a competitive salary, 20% 401k contribution, and extensive paid time off.

Qualifications

• Must hold a Top Secret/SCI U.S. Government security clearance.
• 20+ years of systems engineering experience or equivalent combination of education and experience.

Responsibilities

• Lead design of complex enterprise dataflow architectures.
• Manage high-availability Linux and Cloudera Hadoop infrastructures.
• Engineer end-to-end dataflow solutions using Niagara files and XKS.
• Develop monitoring and automation strategies.
• Provide technical leadership for DevOps initiatives.
• Ensure compliance with security and data handling requirements.
• Coordinate deployment of new capabilities across teams.

Skills

Dataflow architecture

Linux

Cloudera Hadoop

DevOps

Agile/Scrum

Education

Bachelor’s degree in a Qualified Engineering Field

Master’s degree in a Qualified Engineering Field

Tools

Niagara files

XKS

Job description

Build to something to be proud of.

Captivation has built a reputation on providing customers exactly what is needed in a timely manner. Our team of engineers take pride in what they develop and constantly innovate to provide the best solution. Captivation is looking for software developers who can get stuff done while making a difference in support of the mission to protect our country.

Description

Captivation Software is looking for a principal Data Flow Engineer is a senior technical leader responsible for designing, integrating, and sustaining enterprise‑scale dataflow architectures that support mission‑critical analytics across secure cloud and distributed environments. This role oversees high‑availability Linux and Cloudera Hadoop infrastructures, develops and maintains end‑to‑end dataflow solutions using technologies such as Niagara files and XKS, and ensures reliable, secure, and compliant data ingestion, processing, and delivery. The position also leads automation, monitoring, troubleshooting, and DevOps initiatives to improve system performance and operational efficiency while coordinating across engineering, operations, analytics, and stakeholder teams to deploy scalable, resilient, and mission‑focused dataflow capabilities.

Responsibilities

• Lead the design, integration, and sustainment of complex enterprise dataflow architectures supporting mission‑critical analytics, ensuring reliable ingestion, processing, routing, and delivery across large‑scale cloud and distributed environments
• Manage and optimize high‑availability Linux and Cloudera Hadoop cloud infrastructures, including virtual machines, storage containers, and enterprise data repositories, to support thousands of secure operational dataflows
• Engineer and maintain end‑to‑end dataflow solutions using technologies such as Niagarafiles and XKS, and related processing systems, ensuring schema compatibility, metadata integrity, and proper data governance throughout the lifecycle
• Develop and implement monitoring, troubleshooting, and automation strategies utilizing system instrumentation, cron scripting, logging, and operational monitoring tools to improve system continuity, performance, and incident response capabilities
• Provide technical leadership for DevOps and Agile/Scrum initiatives, including task prioritization, workflow modernization, requirements management, and cross‑functional coordination to improve operational efficiency and team performance
• Ensure compliance with enterprise security, classification, and data handling requirements by applying deep knowledge of intelligence community governance policies, access controls, and secure data routing methodologies
• Coordinate across engineering, operations, analytics, and stakeholder organizations to deploy new capabilities, transition systems into production, establish standard operating procedures, and support enterprise‑wide mission objectives through scalable and resilient dataflow solutions.

Requirements

Security Clearance:

• Must currently hold a Top Secret/SCI U.S. Government security clearance with a favorable Polygraph, therefore all candidates must be a U.S. citizen

Minimum Qualifications:

• Bachelor’s degree in a Qualified Engineering Field or related discipline from an accredited college or university with twenty (20) years of systems engineering experience.
• A High School Diploma or GED plus twenty‑four (24) years of general systems engineering experience
• A Master’s degree in a Qualified Engineering Field or a related discipline from an accredited college or university plus eighteen (18) years of systems engineering experience.

Benefits

• Annual Salary: $130,000 - $270,000 (Depends on the Years of Experience)
• Up to 20% 401k contribution (No Matching Required and Vested from Day 1)
• Above Market Hourly Rates
• $3,600 HSA Contribution
• 6 Weeks Paid Time Off
• Company Paid Employee Medical/Dental/Vision Insurance/Life Insurance/Short-Term & Long-Term Disability/AD&D