Senior Data Engineer - Streaming Specialist

Lumenalta (formerly Clevertech); Northern (KY); On-site; USD 80,000 - 130,000; Full time

Benefits offered by this job

Health insurance (medical and dental)

401K

15 days paid time off

Professional development fund

Job summary

Lumenalta is seeking a Senior Data Engineer specializing in streaming to architect and deliver high‑volume pipelines from raw landings to analytics‑ready layers using Kafka, Spark, and Flink on AWS.

This fully remote role requires working in US Pacific, Central, or Eastern time zones; compensation ranges from $80k to $130k annually, with health, 401K, PTO, and professional development. The position emphasizes production readiness, backfill scripting, and cross‑functional collaboration.

Qualifications

• 5+ years in data engineering delivering production-grade pipelines.
• Hands-on experience with Apache Kafka at scale.
• Strong Java or Python and SQL for Spark/Flink pipelines.
• Experience AWS data stack: MSK/Kinesis, EMR, Glue, S3, Lambda, IAM.

Responsibilities

• Architect and implement data landing zones for high-volume streaming event data.
• Design and deploy end-to-end batch and streaming pipelines on AWS using Spark and Flink with exactly-once semantics.
• Tune and manage the Spark & Flink environments and build automated backfill scripts.
• Define and enforce data quality standards and pipeline observability.

Skills

Apache Kafka

Java

Python

SQL

Distributed streaming

AWS

Data pipelines

Tools

MSK

Kinesis

EMR

Glue

S3

Lambda

IAM

Job description

# Senior Data Engineer - Streaming SpecialistData EngineerAt Lumenalta, we partner with forward-thinking organizations to build technology solutions that scale, delight users, and accelerate business growth. Our global teams bring curiosity, commitment, and technical excellence to every project. We value transparency, autonomy, and impact, empowering every team member to do their best work.We're seeking a Senior Data Engineer with deep expertise in distributed streaming architectures to join a high-impact enterprise engagement. This role is an opportunity to architect and deliver complex pipelines across multiple sources, from raw landing zones through to analytics-ready curated layers.#### What You’ll Be Doing* Architect and implement data landing zones for high-volume streaming event data (Kafka Design and deploy end-to-end batch and streaming pipelines on AWS using Spark and Flink, with reliable state management, exactly-once semantics, and incremental processing.* Develop transformation logic to calculate descriptive statistics (min, max, avg, counts) at ingestion time and build advanced streaming pipelines in Flink \\*Tune and manage the Spark & Flink environments. Handle production operations, build automated backfill scripts. \\*Define and enforce data quality standards and pipeline observability practices across all layers of the platform.* Collaborate with cross-functional stakeholders to translate domain requirements into robust, scalable data architecture decisions.#### What We’re Looking For* 5+ years in data engineering with a proven track record of delivering production-grade pipelines in complex, high-volume enterprise environments.* Advanced hands-on experience with Apache Kafka at scale, including topic and partition design, consumer group management, schema registry, and operational tuning.* Strong background in Java or Python and advanced SQL to build production data pipelines using Apache Spark and Apache Flink for batch, stateful streaming, windowing, and complex transformation logic.* Strong AWS background across the data stack: MSK or Kinesis, EMR, Glue, S3, Lambda, and IAM.* Experience managing high-frequency time-series datasets and performing synchronization across misaligned temporal streams. \\*Familiarity with cloud cost management practices, including compute sizing, spend monitoring, and resource optimization. \\*Comfortable owning go-live activities: environment hardening, cutover planning, and post-deployment stabilization in critical production settings.#### Nice to HaveExperience working with HIPAA-regulated data and PHI, including secure handling, anonymization, access controls, and audit requirements.#### Why Lumenalta is an amazing place to work atAt Lumenalta, you can expect that you will:* Be 100% dedicated to one project at a time so that you can innovate and grow.* Be a part of a team of talented and friendly senior-level developers.* Work on projects that allow you to use leading tech.#### LocationThis is a fully remote position; however, candidates must be based in regions that align with the Pacific, Central, or Eastern U.S. time zones to ensure effective collaboration with client and team schedules.#### Application DeadlineApplications will be accepted until **October 11, 2026**. Candidates can expect feedback by October 19, 2026.## Salary**Salary range:** $80k - $130k annually, with final compensation determined by your qualifications, expertise, experience, and the role's scope.## BenefitsIn addition to competitive pay, we offer a variety of benefits to support your professional and personal growth, including:* Flexible working hours in a remote environment.* Health insurance (medical and dental) for W2 Employees.* 401K Contribution.* A professional development fund to enhance your skills and knowledge.* 15 days of paid time off annually.* Access to soft-skill development courses to further your career.## Position DetailsThis is a full-time position requiring a minimum of **40 hours per week, Monday through Friday**.