Senior NiFi ETL Architect for Enterprise Data Lake

Ideal Innovations, Inc.; Bethesda (MD); On-site; USD 131,000 - 202,000; Full time

Job summary

Ideal Innovations, Inc. is seeking an ETL Developer in Bethesda to shape cutting-edge data flow solutions centered on Apache NiFi. You will design NiFi pipelines for large-scale ingestion and processing, optimize performance, and integrate with AWS, Azure, OCI and key services like Kafka and Elasticsearch.

Responsibilities span architecture, development, testing, and DevOps collaboration. You will mentor junior staff and ensure robust, secure, scalable data flows for mission-critical needs.

Qualifications

• Extensive NiFi data flow design in large-scale environments.
• Experience with cloud platforms AWS, Azure, OCI.
• Proficiency in Java and Python for NiFi processor development.
• Strong analytical and cross-functional collaboration skills.

Responsibilities

• Architect enterprise NiFi data pipelines for ingestion and processing.
• Tune performance, memory management, and load balancing.
• Integrate NiFi with AWS, OCI, Azure and services like Kafka, Elasticsearch, S3, SQS/SNS.
• Collaborate with data architects, engineers and stakeholders on solutions.
• Provide mentorship and code reviews to junior developers.

Skills

NiFi design

Java

Python

REST API

Cloud AWS

Cloud Azure

Cloud OCI

Kafka

Elasticsearch

S3

SQS/SNS

Databases (Postgres/DynamoDB)

DevOps

Education

Bachelor's degree with 12+ years

Master's degree with 10+ years

Tools

NiFi Registry

NiFi Clustering

SQL

Job description

Ideal Innovations, Inc. is seeking an ETL Developer in Bethesda to shape cutting-edge data flow solutions centered on Apache NiFi. You will design NiFi pipelines for large-scale ingestion and processing, optimize performance, and integrate with AWS, Azure, OCI and key services like Kafka and Elasticsearch.

Responsibilities span architecture, development, testing, and DevOps collaboration. You will mentor junior staff and ensure robust, secure, scalable data flows for mission-critical needs.