Real-Time Data Engineer - Kafka & Streaming Architect

The Value Maximizer; South Carolina; On-site; USD 120,000 - 150,000; Full time

Job summary

A leading data services provider is seeking a Senior Data Engineer with extensive experience in real-time data streaming using Apache Kafka. The successful candidate will design and build scalable data pipelines and streaming architectures to support analytics and data-driven applications. Responsibilities include optimizing ETL pipelines and collaborating with cross-functional teams. Ideal candidates should have over 8 years of experience in data engineering, strong SQL skills, and familiarity with cloud platforms such as AWS or GCP.

Qualifications

• 8+ years of experience in Data Engineering.
• Strong hands-on experience with Apache Kafka / Kafka Streaming.
• Experience with real-time streaming architectures.

Responsibilities

• Design and maintain real-time data pipelines using Apache Kafka.
• Build scalable stream processing solutions using Kafka Streams, Spark Streaming, or Flink.
• Work with cross-functional teams including Data Scientists and Product Managers.

Skills

Apache Kafka

Python

Java

Scala

Real-time streaming architectures

SQL

AWS

GCP

Azure

Tools

Apache Spark

Apache Flink

Databricks

Docker

Kubernetes

Prometheus

Grafana

Splunk

Job description

A leading data services provider is seeking a Senior Data Engineer with extensive experience in real-time data streaming using Apache Kafka. The successful candidate will design and build scalable data pipelines and streaming architectures to support analytics and data-driven applications. Responsibilities include optimizing ETL pipelines and collaborating with cross-functional teams. Ideal candidates should have over 8 years of experience in data engineering, strong SQL skills, and familiarity with cloud platforms such as AWS or GCP.