Senior Data Engineer

Searchability Aerospace & Defense; Virginia Beach (VA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

null

Job summary

Searchability Aerospace & Defense in Virginia Beach is seeking a dataflow engineer to own the Apache NiFi environment and shape flows for reliable, fast data delivery to operational users.

You will design, tune and maintain NiFi dataflows, own the ingestion/transformation/delivery architecture, and develop custom processors as needed. A TS/SCI clearance is required.

Qualifications

• Three+ years hands-on Apache NiFi experience.
• Experience designing, tuning and troubleshooting production NiFi dataflows.
• Knowledge of clustering, back pressure, provenance, prioritization and failure handling.
• Active TS/SCI clearance and a bachelor's degree in an engineering discipline.
• Experience with NiFi Registry, custom processors and controller services.
• Experience with data ingestion, transformation, and routing in enterprise platforms.

Responsibilities

• Design, build and maintain Apache NiFi dataflows.
• Own the architecture for data ingestion, transformation, routing and delivery.
• Tune flows for performance, reliability and recoverability.
• Develop custom processors and controller services where required.
• Troubleshoot complex dataflow issues during active operations.

Skills

Apache NiFi

Dataflow design

Performance tuning

Troubleshooting

Data ingestion

Clustering

Back pressure

Provenance

Security clearance (TS/SCI)

Education

Bachelor's degree in engineering

Tools

NiFi Registry

Kafka

Cloudera

Windows

Linux

Virtualized infrastructure

Job description

• Active TS/SCI Clearance Required

Summary

This team operates the dataflow environment responsible for moving critical information from collection through transformation, routing and delivery to operational users.

You will take ownership of the Apache NiFi environment, shape how the flows are designed and make the technical decisions that determine how reliably and quickly data reaches the people who need it.

Responsibilities

• Design, build and maintain Apache NiFi dataflows
• Own the architecture for data ingestion, transformation, routing and delivery
• Tune flows for performance, reliability and recoverability
• Develop custom processors and controller services where required
• Troubleshoot complex dataflow issues during active operations

Required Experience

• At least three years of hands‑on Apache NiFi experience
• Experience designing, tuning and troubleshooting production NiFi dataflows
• Knowledge of clustering, back pressure, provenance, prioritization and failure handling
• Active TS/SCI clearance and a bachelor's degree in an engineering discipline
• Apache NiFi and NiFi Registry
• Custom processors and controller services
• Data ingestion, transformation and routing
• Clustering, back pressure and provenance
• Cloudera, Kafka and enterprise data platforms
• Windows, Linux and virtualized infrastructure
• Secure mission systems and operational data environments