Remote Senior Data Engineer - Streaming Specialist

Lumenalta (formerly Clevertech); Northern (KY); Hybrid; USD 80,000 - 130,000; Full time

Benefits offered by this job

Health insurance (medical and dental)

401K

15 days paid time off

Professional development fund

Job summary

Lumenalta is seeking a Senior Data Engineer specializing in streaming to architect and deliver high‑volume pipelines from raw landings to analytics‑ready layers using Kafka, Spark, and Flink on AWS.

This fully remote role requires working in US Pacific, Central, or Eastern time zones; compensation ranges from $80k to $130k annually, with health, 401K, PTO, and professional development. The position emphasizes production readiness, backfill scripting, and cross‑functional collaboration.

Qualifications

• 5+ years in data engineering delivering production-grade pipelines.
• Hands-on experience with Apache Kafka at scale.
• Strong Java or Python and SQL for Spark/Flink pipelines.
• Experience AWS data stack: MSK/Kinesis, EMR, Glue, S3, Lambda, IAM.

Responsibilities

• Architect and implement data landing zones for high-volume streaming event data.
• Design and deploy end-to-end batch and streaming pipelines on AWS using Spark and Flink with exactly-once semantics.
• Tune and manage the Spark & Flink environments and build automated backfill scripts.
• Define and enforce data quality standards and pipeline observability.

Skills

Apache Kafka

Java

Python

SQL

Distributed streaming

AWS

Data pipelines

Tools

MSK

Kinesis

EMR

Glue

S3

Lambda

IAM

Job description

Lumenalta is seeking a Senior Data Engineer specializing in streaming to architect and deliver high‑volume pipelines from raw landings to analytics‑ready layers using Kafka, Spark, and Flink on AWS.

This fully remote role requires working in US Pacific, Central, or Eastern time zones; compensation ranges from $80k to $130k annually, with health, 401K, PTO, and professional development. The position emphasizes production readiness, backfill scripting, and cross‑functional collaboration.