Java-Kafka Developer

Artifintech; Atlanta (GA); On-site; USD 130,000 - 180,000; Full time

Job summary

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is seeking a skilled Java and Apache Kafka expert to design, build, and maintain real-time streaming pipelines. You will implement Kafka producers/consumers, integrate with databases, and optimize performance across microservices.

Ideal candidates have deep Kafka knowledge (Kafka Streams, ZooKeeper, Schema Registry), Spring Boot/JPA, and experience with PostgreSQL or Oracle.

Qualifications

• Core Java with multi-threading, concurrency, and collections.
• Deep knowledge of Kafka architecture including Kafka Streams, ZooKeeper, and Schema Registry.
• Experience with messaging and stream processing on Kafka.
• Microservices architecture experience; Kafka applications built as microservices.
• Experience with PostgreSQL or Oracle databases; data warehousing familiarity.
• Spring ecosystem (Boot, JPA) and ORM frameworks.
• Familiarity with big data tools like Spark, Hadoop, Snowflake.

Responsibilities

• Data pipeline development: Design, build, and maintain real-time streaming pipelines using Apache Kafka and Java.
• Kafka application development: Develop and implement Kafka producer and consumer applications including microservices.
• Integration: Integrate Kafka with existing systems, databases, and data sources.
• Performance optimization: Monitor and troubleshoot Kafka cluster performance, topics, and brokers.
• Maintenance and support: Support and upgrade existing Kafka implementations and troubleshoot issues.
• Security and compliance: Implement security measures to protect data streams and meet compliance standards.

Skills

Core Java

Apache Kafka

Messaging and streaming

Microservices

Databases

Frameworks

Big data technologies

Tools

Spring Boot

Spring JPA

PostgreSQL

Oracle

ZooKeeper

Schema Registry

Kafka Streams

Spark

Hadoop

Snowflake

Job description

8+ years skilled and experienced in design, development, and maintaining real-time data streaming applications using Java and Apache Kafka.

• Data pipeline development: Design, build, and maintain real-time data streaming pipelines using Apache Kafka and Java.
• Kafka application development: Develop and implement Kafka producer and consumer applications, including microservices.
• Integration: Integrate Kafka with various existing systems, databases, and data sources.
• Performance optimization: Monitor and troubleshoot Kafka cluster performance, topics, and brokers for efficiency and scalability.
• Maintenance and support: Support and upgrade existing Kafka implementations and troubleshoot issues.
• Security and compliance: Implement security measures to protect data streams and meet compliance standards.

To be skilled and experienced in:

• Core Java : Strong proficiency in Java, including concepts like multi-threading, concurrency, and collections.
• Apache Kafka : Deep knowledge of Kafka architecture, features, and components like Kafka Streams, ZooKeeper, and Schema Registry.
• Messaging and streaming: Experience with messaging and stream processing on Kafka.
• Microservices: Experience with microservices architecture, as many Kafka applications are built as microservices.
• Databases: Experience with databases and data warehousing technologies (e.g., PostgreSQL, Oracle) is often required or preferred
• Frameworks: Experience with frameworks like Spring (Spring Boot, Spring JPA) and ORM frameworks.
• Big data technologies: Familiarity with big data technologies like Spark, Hadoop, or Snowflake.

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract