Senior NiFi Data Engineer – Real-Time ETL & Cloud

Ideal Innovations Incorporated; Bethesda (MD); On-site; USD 150,000 - 190,000; Full time

Job summary

Ideal Innovations Incorporated in Bethesda, MD is seeking an ETL Developer to shape and implement data flow solutions around Apache NiFi. You will design and optimize NiFi pipelines for batch and real-time processing, integrating with AWS, Azure, OCI, Kafka, Elasticsearch, S3, and SQS/SNS.

This role participates in the DevOps lifecycle, mentors junior developers, and collaborates with data architects and engineers to deliver scalable, secure data solutions for critical customer needs.

Qualifications

• Active TS/SCI with polygraph clearance is required.
• Bachelor's degree with 12+ years or Master's with 10+ years, substitutions allowed.
• Deep NiFi data flow design and management in large-scale enterprise settings.
• Proficiency in Java and Python for NiFi processor development.
• Experience with cloud platforms (AWS, Azure, OCI) and data services.
• Strong SQL and NoSQL experience (Postgres, Elasticsearch, DynamoDB).
• Experience with real-time streaming, REST APIs, and data integration.

Responsibilities

• Architect complex NiFi data pipelines for ingestion, transformation, and processing at scale.
• Tune NiFi for batch and real-time performance, memory management, and load balancing.
• Diagnose and resolve NiFi data flow issues and bottlenecks.
• Integrate NiFi with AWS, OCI, Azure and services like Kafka, Elasticsearch, S3, SQS/SNS.
• Set best practices for NiFi development, security, and governance.
• Create comprehensive documentation for NiFi flows, mappings, and architectures.
• Collaborate with data architects, engineers and developers to deliver robust solutions.
• Mentor junior developers and lead peers through code reviews and guidance.

Skills

Mentorship

Cross-functional teamwork

Communication skills

Problem solving

Education

Bachelor's degree

Master's degree

Tools

NiFi

NiFi Registry

NiFi clustering

Java

Python

SQL

REST

AWS

Azure

OCI

Kafka

Elasticsearch

S3

SQS/SNS

PostgreSQL

DynamoDB

Job description

Ideal Innovations Incorporated in Bethesda, MD is seeking an ETL Developer to shape and implement data flow solutions around Apache NiFi. You will design and optimize NiFi pipelines for batch and real-time processing, integrating with AWS, Azure, OCI, Kafka, Elasticsearch, S3, and SQS/SNS.

This role participates in the DevOps lifecycle, mentors junior developers, and collaborates with data architects and engineers to deliver scalable, secure data solutions for critical customer needs.