Senior NiFi ETL Engineer | Real-Time Data Pipelines

Ideal Innovations Incorporated; Bethesda (MD); On-site; USD 120,000 - 180,000; Full time

Job summary

Ideal Innovations, Inc. in Bethesda, MD seeks an ETL Developer to design and optimize NiFi data pipelines for batch and real-time processing. You will integrate NiFi with AWS, Azure, OCI, Kafka, Elasticsearch, S3, and SQS/SNS, delivering secure, scalable data flows in a DevOps environment.

Applicants must have an active TS/SCI with polygraph, a relevant degree, and 4+ years of NiFi experience in large-scale settings; strong Java/Python and REST API skills are essential.

Qualifications

• Active TS/SCI with polygraph clearance.
• Bachelor's degree with 4+ years of relevant experience or Master's with 2+ years.
• Direct experience designing NiFi data flow solutions in large-scale enterprise environments.
• Experience with Java and/or Python and scripting for automation.
• Experience with relational/NoSQL databases (Postgres, Elasticsearch, DynamoDB).
• Cloud experience with AWS, Azure, or OCI and related data services.

Responsibilities

• Build enterprise NiFi data pipelines for large-scale ingestion, transformation, and processing.
• Tune NiFi data flows for batch and real-time processing, memory management, and load balancing.
• Diagnose and resolve NiFi data flow issues and performance bottlenecks.
• Integrate NiFi with cloud platforms and services (Kafka, Elasticsearch, S3, SQS/SNS).
• Follow NiFi development, deployment, security, and governance best practices.
• Create and maintain documentation for NiFi data flows, mappings, and architectures.
• Collaborate with data architects, engineers, and developers to translate requirements into solutions.

Skills

NiFi design

Java

Python

REST API

Kafka

Elasticsearch

DynamoDB

S3

Education

Bachelor's degree

Master's degree

Tools

AWS

Azure

OCI

Job description

Ideal Innovations, Inc. in Bethesda, MD seeks an ETL Developer to design and optimize NiFi data pipelines for batch and real-time processing. You will integrate NiFi with AWS, Azure, OCI, Kafka, Elasticsearch, S3, and SQS/SNS, delivering secure, scalable data flows in a DevOps environment.

Applicants must have an active TS/SCI with polygraph, a relevant degree, and 4+ years of NiFi experience in large-scale settings; strong Java/Python and REST API skills are essential.