Senior Java Kafka Developer for Real-Time Data Pipelines

Artifintech; Atlanta (GA); On-site; USD 130,000 - 180,000; Full time

Job summary

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is seeking a skilled Java and Apache Kafka expert to design, build, and maintain real-time streaming pipelines. You will implement Kafka producers/consumers, integrate with databases, and optimize performance across microservices.

Ideal candidates have deep Kafka knowledge (Kafka Streams, ZooKeeper, Schema Registry), Spring Boot/JPA, and experience with PostgreSQL or Oracle.

Qualifications

• Core Java with multi-threading, concurrency, and collections.
• Deep knowledge of Kafka architecture including Kafka Streams, ZooKeeper, and Schema Registry.
• Experience with messaging and stream processing on Kafka.
• Microservices architecture experience; Kafka applications built as microservices.
• Experience with PostgreSQL or Oracle databases; data warehousing familiarity.
• Spring ecosystem (Boot, JPA) and ORM frameworks.
• Familiarity with big data tools like Spark, Hadoop, Snowflake.

Responsibilities

• Data pipeline development: Design, build, and maintain real-time streaming pipelines using Apache Kafka and Java.
• Kafka application development: Develop and implement Kafka producer and consumer applications including microservices.
• Integration: Integrate Kafka with existing systems, databases, and data sources.
• Performance optimization: Monitor and troubleshoot Kafka cluster performance, topics, and brokers.
• Maintenance and support: Support and upgrade existing Kafka implementations and troubleshoot issues.
• Security and compliance: Implement security measures to protect data streams and meet compliance standards.

Skills

Core Java

Apache Kafka

Messaging and streaming

Microservices

Databases

Frameworks

Big data technologies

Tools

Spring Boot

Spring JPA

PostgreSQL

Oracle

ZooKeeper

Schema Registry

Kafka Streams

Spark

Hadoop

Snowflake

Job description

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is seeking a skilled Java and Apache Kafka expert to design, build, and maintain real-time streaming pipelines. You will implement Kafka producers/consumers, integrate with databases, and optimize performance across microservices.

Ideal candidates have deep Kafka knowledge (Kafka Streams, ZooKeeper, Schema Registry), Spring Boot/JPA, and experience with PostgreSQL or Oracle.