Senior Kafka Developer

Veriipro; Charlotte (NC); On-site; USD 140,000 - 190,000; Full time

Job summary

Veriipro is seeking a senior software engineer specializing in real-time data streaming with Apache Kafka to design and maintain high-throughput data pipelines in the Charlotte, NC area. You will implement Kafka-based architectures, manage clusters, and collaborate with cross-functional teams to deliver scalable event-driven solutions that ensure reliable data delivery and low latency.

Candidates should have 10+ years in software development and data engineering, deep knowledge of Kafka

Qualifications

• 10+ years in software development and data engineering.
• Strong hands-on Apache Kafka development and implementation.
• Expertise in real-time streaming applications and event-driven architectures.
• Experience building scalable, fault-tolerant data pipelines.
• Understanding of Kafka components: Brokers, Topics/Partitions, Producers/Consumers, Kafka Streams, Kafka Connect, Schema Registry.
• Real-time stream processing using Kafka Streams and/or KSQL.
• Knowledge of Hadoop ecosystem technologies preferred.
• Strong troubleshooting and performance optimization skills.

Responsibilities

• Design, develop, and maintain real-time streaming applications using Apache Kafka.
• Build and optimize high-throughput, fault-tolerant data pipelines.
• Develop and maintain Kafka producer and consumer applications.
• Configure, manage, and monitor Kafka clusters, brokers, topics, and partitions.
• Implement integrations using Kafka Connect with external systems and data sources.
• Develop stream processing solutions using Kafka Streams and KSQL.
• Manage data serialization formats and resolve serialization issues.
• Analyze performance bottlenecks and optimize Kafka cluster performance.
• Troubleshoot message delivery, connectivity, and data processing issues.
• Collaborate with engineering teams to design scalable event-driven solutions.

Skills

Apache Kafka

Kafka Streams

KSQL

Hadoop

Real-time streaming

Event-driven architecture

Data pipelines

Troubleshooting

Tools

Kafka Connect

Schema Registry

Kafka Brokers

Topics and Partitions

Job description

Required Technical/Functional Skills

• Minimum 10 years of experience in software development and data engineering.
• Strong hands‑on experience with Apache Kafka development and implementation.
• Expertise in designing and developing real‑time data streaming applications and event‑driven architectures.
• Experience building scalable, reliable, and fault‑tolerant data pipelines.
• Strong understanding of Kafka components including:
  • Kafka Brokers
  • Topics and Partitions
  • Producers and Consumers
  • Kafka Streams
  • Kafka Connect
  • Schema Registry
• Experience with real‑time stream processing using Kafka Streams and/or KSQL.
• Knowledge of Hadoop ecosystem technologies preferred.
• Strong troubleshooting and performance optimization skills.

Primary Responsibilities

• Design, develop, and maintain real‑time streaming applications using Apache Kafka.
• Build and optimize high‑throughput, fault‑tolerant data pipelines.
• Develop and maintain Kafka producer and consumer applications.
• Configure, manage, and monitor Kafka clusters, brokers, topics, and partitions.
• Implement integrations using Kafka Connect with external systems and data sources.
• Develop stream processing solutions using Kafka Streams and KSQL.
• Manage data serialization formats and resolve serialization‑related issues.
• Analyze performance bottlenecks and optimize Kafka cluster performance.
• Troubleshoot message delivery, connectivity, and data processing issues.
• Collaborate with engineering teams to design scalable event‑driven solutions.

Preferred Qualifications

• Experience with large‑scale distributed systems and cloud‑based data platforms.
• Strong understanding of data engineering and streaming architecture patterns.
• Experience working with Hadoop and big data processing environments.
• Excellent analytical, troubleshooting, and communication skills.