NiFi ETL Engineer – Big Data & Cloud

Ideal-Innovations,-Inc.-1; Bethesda (MD); On-site; USD 87,000 - 134,000; Full time

Job summary

Ideal Innovations, Inc. in Bethesda, MD is seeking an ETL Developer to design and implement NiFi-based data pipelines across on-prem and cloud environments. The role emphasizes performance tuning, scalability, and security within a DevOps framework, with a focus on integrating AWS, Azure, OCI, Kafka, Elasticsearch, S3, and SQS/SNS.

An active TS/SCI clearance is required. You will collaborate with data architects, engineers, and stakeholders to translate complex data requirements into robust,

Qualifications

• Active TS/SCI with polygraph clearance.
• Experience designing, developing, and managing NiFi data flows.
• Programming in Java and/or Python; automation scripting.
• Experience with relational and NoSQL databases (Postgres, Elasticsearch, DynamoDB).
• Cloud experience with AWS, Azure or OCI; REST API integration.
• Ability to analyze data challenges and collaborate across teams.
• Strong communication and cross-functional teamwork skills.

Responsibilities

• Build and implement enterprise NiFi data pipelines for large-scale ingestion and processing.
• Tune performance, memory, and load balancing for batch and real-time processing.
• Diagnose and resolve NiFi data flow issues and bottlenecks.
• Integrate NiFi with cloud services (AWS, OCI, Azure) and related data tech.
• Follow NiFi best practices for security, governance, and deployment.
• Document data flows, mappings, and architectures for knowledge transfer.
• Collaborate with data architects, engineers, and stakeholders to deliver robust solutions.

Skills

NiFi data pipelines

Java

Python

REST API

Cloud platforms

Education

Bachelor's degree + 4+ years

Master's degree + 2+ years

Tools

NiFi

NiFi Registry

Kafka

Elasticsearch

S3

Job description

Ideal Innovations, Inc. in Bethesda, MD is seeking an ETL Developer to design and implement NiFi-based data pipelines across on-prem and cloud environments. The role emphasizes performance tuning, scalability, and security within a DevOps framework, with a focus on integrating AWS, Azure, OCI, Kafka, Elasticsearch, S3, and SQS/SNS.

An active TS/SCI clearance is required. You will collaborate with data architects, engineers, and stakeholders to translate complex data requirements into robust,