Senior Java-Kafka Real-Time Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Atlanta (GA); On-site; USD 83,000 - 138,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Atlanta, GA is seeking a seasoned Java-Kafka Developer to design, build, and maintain real-time data streaming pipelines using Java and Apache Kafka. Responsibilities include developing Kafka producers and consumers, building microservices, integrating Kafka with databases and data sources, and monitoring cluster performance for scalability.

The role emphasizes security and compliance, troubleshooting, and ongoing upgrades to keep the streaming platform

Qualifications

• Core Java proficiency including multi-threading, concurrency, and collections.
• Kafka architecture, features, and components like Kafka Streams, ZooKeeper, and Schema Registry.
• Experience with messaging and stream processing on Kafka.
• Microservices architecture and development.
• Databases/data warehousing technologies such as PostgreSQL or Oracle.
• Spring (Spring Boot, Spring JPA) and ORM frameworks.
• Big data tech like Spark, Hadoop, or Snowflake.

Responsibilities

• Design, build, and maintain real-time data streaming pipelines using Java and Apache Kafka.
• Develop and implement Kafka producer and consumer applications, including microservices.
• Integrate Kafka with various existing systems, databases, and data sources.
• Monitor and troubleshoot Kafka cluster performance, topics, and brokers for efficiency and scalability.
• Support and upgrade existing Kafka implementations and troubleshoot issues.
• Implement security measures to protect data streams and meet compliance standards.

Skills

Core Java

Apache Kafka

Messaging & Streaming

Microservices

Databases

Spring Framework

Big Data Technologies

Tools

Kafka Streams

ZooKeeper

Schema Registry

PostgreSQL

Oracle

Job description

MACHINE LEARNING TECHNOLOGIES LLC in Atlanta, GA is seeking a seasoned Java-Kafka Developer to design, build, and maintain real-time data streaming pipelines using Java and Apache Kafka. Responsibilities include developing Kafka producers and consumers, building microservices, integrating Kafka with databases and data sources, and monitoring cluster performance for scalability.

The role emphasizes security and compliance, troubleshooting, and ongoing upgrades to keep the streaming platform