Senior Streaming Data Engineer – Remote & AWS/Kafka Focus

Lumenalta; United States; Remote; USD 80,000 - 130,000; Full time

Benefits offered by this job

Health insurance

401K contribution

Paid time off

Professional development fund

Job summary

Lumenalta’s Senior Data Engineer - Streaming Specialist role is fully remote for US-based candidates. You will architect and deliver high-volume streaming pipelines from Kafka landing zones through analytics-ready layers, using Spark and Flink on AWS.

You will own end-to-end data pipelines, ensure exactly-once semantics, implement data quality and observability, and collaborate with stakeholders to translate domain requirements into scalable architectures.

Qualifications

• 5+ years in data engineering.
• Kafka at scale, topic/partition design, and schema registry.
• Java or Python and Advanced SQL for pipelines with Spark/Flink.
• Experience with AWS data stack (MSK/Kinesis, EMR, Glue, S3).

Responsibilities

• Architect data landing zones for high-volume streaming data.
• Develop streaming pipelines with Spark and Flink, ensuring exactly-once semantics.
• Tune and manage Spark & Flink environments; implement backfill scripts.
• Define and enforce data quality standards and observability across the platform.

Skills

Data engineering 5+yr

Java or Python

Advanced SQL

Cloud cost mgmt

Go-live readiness

Tools

Apache Kafka

Apache Spark

Apache Flink

AWS

Job description

Lumenalta’s Senior Data Engineer - Streaming Specialist role is fully remote for US-based candidates. You will architect and deliver high-volume streaming pipelines from Kafka landing zones through analytics-ready layers, using Spark and Flink on AWS.

You will own end-to-end data pipelines, ensure exactly-once semantics, implement data quality and observability, and collaborate with stakeholders to translate domain requirements into scalable architectures.