Senior Real-Time Streaming Data Engineer - Kafka & ELK

ALLTECH CONSULTING SVC INC; Alpharetta (GA); On-site; USD 90,000 - 120,000; Full time

Job summary

A technology consulting firm in Georgia is seeking a Streaming Data Engineer to design and develop ETL pipelines and work with large-scale data systems. The ideal candidate has at least 5 years of application development experience, with a focus on data engineering using Kafka, and strong coding skills in Python or Java. This role involves working on distributed systems architecture, and the ability to learn new technologies is essential.

Qualifications

• 5 years of application development experience required.
• At least 2 years of data engineering experience with Kafka.
• Experience writing applications on Linux.

Responsibilities

• Understand distributed systems architecture.
• Design and develop ETL pipelines.
• Lead full cycle of development including requirements, design, and implementation.

Skills

Application development experience

Data engineering with Kafka

Coding in Python

Coding in Java

SQL and database experience

Tools

Linux

AWS

ElasticSearch ELK

Job description

A technology consulting firm in Georgia is seeking a Streaming Data Engineer to design and develop ETL pipelines and work with large-scale data systems. The ideal candidate has at least 5 years of application development experience, with a focus on data engineering using Kafka, and strong coding skills in Python or Java. This role involves working on distributed systems architecture, and the ability to learn new technologies is essential.