Job Search and Career Advice Platform

Enable job alerts via email!

Apache NiFi Engineer

Sureminds Solutions Pvt. Ltd.

Dubai

On-site

AED 120,000 - 200,000

Full time

Yesterday
Be an early applicant

Generate a tailored resume in minutes

Land an interview and earn more. Learn more

Job summary

A leading tech solutions company in Dubai is seeking an experienced Apache NiFi Engineer with 5+ years of experience. The ideal candidate will develop and optimize data flows, manage complex integrations with MongoDB and Apache Kafka, and optimize NiFi environments. Proficiency in Groovy scripting and understanding of Linux systems are essential. This role offers an exciting opportunity to work in a production-grade, high-availability NiFi environment.

Qualifications

  • 5+ years of hands-on experience with Apache NiFi.
  • Proven experience with Cloudera NiFi in enterprise environments.
  • Strong proficiency in Groovy scripting.

Responsibilities

  • Develop and optimize complex data flows in production environments.
  • Integrate NiFi with MongoDB and Apache Kafka.
  • Debug and optimize NiFi flows using Data Provenance.

Skills

Apache NiFi
Groovy scripting
SSH/SFTP protocols
Data encryption mechanisms
MongoDB integration
Apache Kafka
Red Hat Enterprise Linux

Tools

Prometheus
Grafana
Cloudera Manager
Job description
Description
Role - Apache Nifi Engineer
Location - Dubai
Exp - 5 to 13 years
Notice - 0-30 days
Job Description
Required Experience
  • 5+ years of hands‑on experience with Apache NiFi, including developing, managing, and optimizing complex data flows in production environments.
  • Proven experience with Cloudera NiFi (CDP Data Flow) in enterprise environments, including integration with Cloudera Manager.
  • Experience migrating NiFi flows across major version upgrades with strong understanding of backward compatibility.
  • Strong proficiency in Groovy scripting, used for ExecuteScript and InvokeScriptedProcessor processors.
  • Solid understanding of SSH and SFTP protocols, including authentication schemes (key‑based, password), session negotiation, and file permissions handling in NiFi processors (e.g., ListSFTP, FetchSFTP, PutSFTP).
  • Good grasp of data encryption mechanisms, key management, and secure flowfile handling using processors like EncryptContent.
  • Experience integrating NiFi with MongoDB, including reading / writing documents via processors like GetMongo, PutMongo, and QueryMongo.
  • Experience working with Apache Kafka, including producing and consuming from Kafka topics using NiFi (PublishKafka, ConsumeKafka), and handling schema evolution with Confluent Schema Registry.
  • Strong knowledge of Red Hat Enterprise Linux (RHEL) environments, including systemd services, filesystem permissions, log rotation, and resource tuning for JVM‑based applications like NiFi.
NiFi‑Specific Technical Requirements
  • In‑depth knowledge of NiFi flow design principles, including proper use of queues, back pressure, prioritizers, and connection tuning.
  • Mastery of controller services, including SSLContextService, DBCPConnectionPool, and RecordReader / RecordWriter services.
  • Experience with Record‑based processing using Avro, JSON, CSV schemas and Record processors like ConvertRecord, QueryRecord, and LookupRecord.
  • Ability to debug and optimize NiFi flows using Data Provenance, bulletins, and log analysis.
  • Familiarity with custom processor development in Java / Groovy (optional but preferred).
  • Experience setting up secure NiFi clusters, configuring user authentication (LDAP, OIDC), TLS certificates, and access policies.
  • Proficiency in parameter contexts, variable registry, and flow versioning using NiFi Registry.
  • Understanding of Zero‑Master clustering model, node coordination, and site‑to‑site protocol.
  • Experience deploying and monitoring NiFi in high‑availability, production‑grade environments, including using Prometheus / Grafana or Cloudera Manager for metrics and alerting.
Preferred Qualifications
  • Experience working in regulated or secure environments, with strict data handling and audit requirements.
  • Familiarity with DevOps workflows, including version‑controlled flow templates (JSON / XML), CI / CD integration for NiFi Registry, and automated deployment strategies.
  • Strong written and verbal communication skills, with ability to document flows and onboard other engineers.
Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.