Senior Software Engineer - Streaming (Kafka)

Innovaccer; United States; On-site; USD 130,000 - 170,000; Full time

Benefits offered by this job

PTO 20 days

Parental leave

Recognition & Rewards

Medical insurance

Job summary

Innovaccer is seeking a Senior Software Engineer for the Streaming team to own the messaging backbone of our on-premise platform, including Kafka, Schema Registry on OpenShift via Strimzi, and the self-hosted queueing layer replacing cloud services.

You will design patterns, libraries, and infrastructure to scale reliability across hundreds of producer/consumer touchpoints and ensure seamless integration with the platform runtime.

Qualifications

• 5+ years of backend or data infrastructure experience with production Kafka ownership.
• Experience running Kafka on Kubernetes (Strimzi preferred) and Schema Registry.
• Hands-on with at least one other broker technology: RabbitMQ, ActiveMQ/Artemis, or NATS/JetStream.

Responsibilities

• Deploy and operate Kafka and Schema Registry on OpenShift via Strimzi.
• Redesign integrations from cloud queue services to self-hosted brokers.
• Build shared client patterns: retries, dead-letter queues, idempotent consumers.
• Integrate messaging with the platform’s function runtime via KEDA-driven scaling.
• Own capacity planning for the messaging tier and monitor broker health.

Skills

Kafka

OpenShift

Strimzi

Schema Registry

Java

Python

Go

Back-end development

Distributed systems

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

OpenShift

Kubernetes

RabbitMQ

ActiveMQ/Artemis

NATS/JetStream

Schema Registry

Job description

As a Senior Software Engineer on the Streaming team, you will own the messaging backbone of Innovaccer's on-premise platform: Kafka and Schema Registry running on OpenShift via Strimzi, plus the self-hosted queueing layer that replaces cloud-managed queue services. A large population of producer and consumer touchpoints across the platform moves from cloud queue services onto this backbone, and you will define the patterns, libraries, and infrastructure that make that shift reliable at scale.

A Day in the Life

• Deploy and operate Kafka and Schema Registry on OpenShift via Strimzi: topic and partition design, retention policies, security, and quota management.
• Redesign integrations built on cloud queue services (SQS/Service Bus patterns) onto self-hosted brokers, defining repeatable patterns for hundreds of producer and consumer touchpoints.
• Build shared client patterns and libraries: retries, dead-letter queues, idempotent consumers, ordering guarantees, and backpressure handling.
• Integrate messaging with the platform's function runtime through KEDA-driven scaling of queue consumers.
• Own capacity planning for the messaging tier: broker disk and IO sizing, throughput modeling, and growth headroom.
• Monitor consumer lag and broker health, run failure-mode testing, and harden the tier against node and site failures.

What You Need

• B.E., B.Tech., M.Sc. degree in Computer Science or a related technical field.
• 5+ years of backend or data infrastructure experience, with significant production Kafka ownership covering both operations and client-side development.
• Experience running Kafka on Kubernetes (Strimzi preferred) and managing schema evolution with Schema Registry.
• Hands-on experience with at least one additional broker technology: RabbitMQ, ActiveMQ/Artemis, or NATS/JetStream.
• Strong grasp of messaging semantics: delivery guarantees, idempotency, ordering, and exactly-once processing patterns.
• Professional development experience with Java, Python, or Go.
• Experience with KEDA or event-driven autoscaling is a plus; regulated-environment experience is a plus.

We offer competitive benefits to set you up for success in and outside of work.

Here’s What We Offer

• Generous Paid Time Off: Recharge and relax with 20 days of fixed time off per year, in addition to company holidays—because we believe work-life balance fuels performance.
• Best-in-Class Parental Leave: Spend quality time with your growing family. We offer one of the industry’s most generous parental leave policies to support you during life’s most important moments.
• Recognition & Rewards: We celebrate wins—big and small. Get rewarded with monetary incentives and company-wide recognition for your impact and dedication. Your hard work won’t go unnoticed.
• Comprehensive Insurance Coverage: Stay covered with medical, dental, and vision insurance, plus 100% company-paid short- and long-term disability and basic life insurance. Optional perks include discounted legal aid and pet insurance.

Innovaccer Inc. is an equal opportunity employer. We celebrate diversity and are committed to fostering an inclusive workplace where all employees feel valued and empowered regardless of any characteristic protected by federal, state or local law including, without limitation, race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, medical condition, disability, age, marital status, or veteran status. Innovaccer Inc. participates in the E-Verify program to confirm employment eligibility of all newly hired employees based out of the U.S. and employed by Innovaccer Inc.