Senior Real-Time Streaming Architect - CDP Stack

Compunnel, Inc.; Oregon (WI); Remote; USD 120,000 - 150,000; Full time

Job summary

A leading data solutions firm is seeking a Lead Cloudera Consultant (Solution Architect) to design and optimize real-time streaming pipelines. The role demands extensive experience with Cloudera Data Platform components such as NiFi and Kafka to implement ingestion, transformation, and integration pipelines. Candidates should have over 8 years in data engineering, with a focus on high-volume systems. This position offers a unique opportunity to mentor teams while driving architectural decisions in a cutting-edge streaming ecosystem.

Qualifications

• 8+ years of experience in data engineering or streaming system development.
• 3–5+ years of hands-on experience with Cloudera CDP/CDF streaming components.
• Experience with high-volume industries such as financial services, healthcare, or telecom is preferred.

Responsibilities

• Architect and build end-to-end real-time pipelines using NiFi, Kafka, and Flink.
• Develop advanced NiFi flows including JDBC services and schema registry integration.
• Collaborate with engineering teams to optimize deployments and configurations.

Skills

NiFi

Kafka

Flink

SQL

Kudu

CDC patterns

Snowflake ingestion

Job description

A leading data solutions firm is seeking a Lead Cloudera Consultant (Solution Architect) to design and optimize real-time streaming pipelines. The role demands extensive experience with Cloudera Data Platform components such as NiFi and Kafka to implement ingestion, transformation, and integration pipelines. Candidates should have over 8 years in data engineering, with a focus on high-volume systems. This position offers a unique opportunity to mentor teams while driving architectural decisions in a cutting-edge streaming ecosystem.