Real-Time Streaming Data Architect & Tech Lead

Compunnel, Inc.; Tampa (FL); On-site; USD 150,000 - 190,000; Full time

Job summary

Compunnel, Inc. is seeking a Lead Streaming Data Engineer / Technical Lead in Tampa, FL to design, build, and lead real‑time data processing platforms using Spark Structured Streaming, AWS Flink, and Kafka.

The role combines hands‑on development with architecture decisions and technical leadership. You will mentor onshore and offshore teams, drive design reviews and production readiness, optimize performance and cost, and partner with stakeholders to deliver enterprise‑scale streaming solutions

Qualifications

• 10+ years of overall professional experience.
• 5+ years of real-time streaming and distributed data processing experience.
• Hands-on expertise in Spark Structured Streaming.
• Hands-on experience with AWS Flink and Apache Kafka.
• Proficiency in Python or Java.
• Experience designing scalable, fault-tolerant streaming apps.
• Experience providing technical leadership and mentoring.
• Understanding security, governance, and compliance for enterprise data platforms.

Responsibilities

• Lead architecture and implementation of real-time data pipelines.
• Build scalable streaming apps using Spark, Flink, Kafka.
• Develop real-time pipelines with Spark and Python.
• Define standards, guidelines, and best practices.
• Drive design reviews, code reviews, and production readiness.
• Mentor onshore and offshore teams.
• Troubleshoot production incidents and ensure security/compliance.

Skills

Apache Spark Structured Streaming

AWS Flink

Apache Kafka

Python

Java

Tools

Python

Java

Job description

Compunnel, Inc. is seeking a Lead Streaming Data Engineer / Technical Lead in Tampa, FL to design, build, and lead real‑time data processing platforms using Spark Structured Streaming, AWS Flink, and Kafka.

The role combines hands‑on development with architecture decisions and technical leadership. You will mentor onshore and offshore teams, drive design reviews and production readiness, optimize performance and cost, and partner with stakeholders to deliver enterprise‑scale streaming solutions