NiFi ETL Architect Lead — Real-Time Data Pipelines

Ideal-Innovations,-Inc.-1; Bethesda (MD); On-site; USD 131,000 - 202,000; Full time

Job summary

Ideal Innovations, Inc. is seeking an ETL Developer to design and implement NiFi-based data pipelines within a DevOps environment.

Based onsite in Bethesda, MD, you will build scalable, secure data flows across AWS, Azure and OCI, while collaborating with data architects and engineers to deliver robust solutions. You will mentor junior developers, perform code reviews, and help define best practices for NiFi development, deployment, and governance in large-scale enterprise deployments, under a

Qualifications

• Active TS/SCI with polygraph required for consideration.
• Bachelor's degree with 12+ years of relevant experience or Master's with 10+ years of relevant experience.
• In-depth NiFi data flow design and management in large-scale enterprise environments.
• Experience with NiFi Registry and clustering for high availability and scalability.
• Proficient in Java and Python for custom NiFi development and automation.
• Experience with relational and NoSQL databases (e.g., Postgres, Elasticsearch, DynamoDB).
• Real-time streaming and REST API integration experience.

Responsibilities

• Architect complex NiFi data pipelines for large-scale ingestion, transformation, and processing.
• Tune NiFi for performance, memory management, and load balancing.
• Diagnose and resolve NiFi data flow issues and bottlenecks.
• Integrate NiFi with AWS, Azure, OCI, Kafka, Elasticsearch, S3, and SQS/SNS.
• Define best practices for NiFi development, deployment, security, and governance.
• Create and maintain documentation for NiFi data flows and architectures.
• Collaborate with data architects, engineers, and developers to deliver robust solutions.
• Mentor junior developers and conduct code reviews.

Skills

NiFi

Java

Python

REST API

SQL

PostgreSQL

Elasticsearch

DynamoDB

AWS

Azure

OCI

NiFi Registry

NoSQL databases

Cloud integration

Education

Bachelor's degree + 12+ years experience

Master's degree + 10+ years experience

Tools

NiFi

NiFi Registry

Kafka

S3

SQS/SNS

PostgreSQL

DynamoDB

Elasticsearch

Cloud platforms (AWS/Azure/OCI)

Job description

Ideal Innovations, Inc. is seeking an ETL Developer to design and implement NiFi-based data pipelines within a DevOps environment.

Based onsite in Bethesda, MD, you will build scalable, secure data flows across AWS, Azure and OCI, while collaborating with data architects and engineers to deliver robust solutions. You will mentor junior developers, perform code reviews, and help define best practices for NiFi development, deployment, and governance in large-scale enterprise deployments, under a