Networking C++ R&D Developer

Persistent Systems; Pune District; Hybrid; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Competitive salary and benefits

Talent development culture

Cutting‑edge technologies

Flexible work hours

Long Service awards

Insurance coverage

Job summary

Persistent Systems is seeking a Networking C++ R&D Developer to own the distributed messaging library powering our analytics platform. You will build a high‑performance Pub/Sub framework across Kafka, Pulsar, Redis, and ZeroMQ, ensuring API parity with Java and Python while driving scalability and reliability.

You will design and maintain the HTTP REST server/client, Protobuf schemas, and service discovery, collaborating with Capture, Protocol Analysis, and Decryption teams to evolve APIs and

Qualifications

• Strong experience in designing and developing distributed messaging systems and high‑performance event‑driven platforms.
• Deep expertise in C++ development, including multithreading, concurrency, memory management, and low‑latency system design.
• Hands‑on experience with messaging technologies such as Apache Kafka, Apache Pulsar, ZeroMQ, Redis, and Redis Cluster.
• Proficiency in developing and maintaining cross‑language integrations and bindings for C++, Java, and Python environments.
• Strong understanding of Pub/Sub architectures, service discovery, distributed communication patterns, and scalable microservices ecosystems.

Responsibilities

• Design, implement, and maintain the unified Pub/Sub abstraction layer with pluggable backends: ZeroMQ, Apache Kafka, Apache Pulsar, and Redis/RedisCluster.
• Maintain Java (JNA) and Python bindings to the core C++ library, ensuring API parity and correct memory/lifecycle semantics across language boundaries.
• Maintain and evolve service discovery, including DNS‑based dynamic endpoint resolution with change detection and REST API‑based publisher configuration discovery.
• Develop and maintain partition logic, including hostname‑aware Kafka/Pulsar partition assignment for Kubernetes Stateful Set‑scaled consumer pods.
• Implement and optimise performance‑critical utilities, including lock‑free circular buffers, time‑reorder queues, CPU affinity enforcement for messaging threads, and ZSTD compression with custom dictionary support.
• Maintain the Redis client library, including cluster‑aware connection management, RESP protocol handling, and health statistics reporting.
• Own the HTTP REST server and client components, including the OpenAPI‑based code generation pipeline.
• Define and enforce the Protobuf message schema used for inter‑component event serialization, while managing schema evolution and backward compatibility.
• Maintain a flow‑based traffic filtering library for targeted data delivery to downstream consumers.
• Write and maintain comprehensive unit and integration tests across C++, Java, and Python language bindings.
• Work closely with consuming teams including Capture, Protocol Analysis, and Decryption teams to evolve the library APIs in response to new requirements without impacting existing consumers.
• Participate in code reviews, architecture discussions, and technical design sessions.
• Create, maintain, and update technical documentation, operational procedures, and development guidelines.
• Ensure platform performance, scalability, reliability, and maintainability across all supported messaging backends.
• Troubleshoot complex issues related to messaging, serialization, service discovery, networking, and distributed systems environments.

Skills

Distributed messaging

C++ development

Multithreading

Cross-language bindings

API parity

Kafka

Pulsar

ZeroMQ

Tools

Kafka

Pulsar

ZeroMQ

Redis

Job description

We are looking for a Networking C++ R&D Developer to own the distributed messaging and networking library that serves as the core communication backbone of our analytics platform. This platform engineering role focuses on building and maintaining a high-performance, reliable Pub/Sub framework across multiple messaging technologies, including Kafka, Pulsar, Redis, and ZeroMQ. You will ensure API consistency across C++, Java, and Python environments while driving scalability, performance, and platform reliability for teams across packet capture, protocol analysis, decryption, and downstream processing systems.

• Role: Networking C++ R&D Developer
• Location: All Persistent Location
• Experience: 6 to 14 Years
• Job Type: Full-Time Employment

What You'll Do:

• Design, implement, and maintain the unified Pub/Sub abstraction layer with pluggable backends: ZeroMQ, Apache Kafka, Apache Pulsar, and Redis/RedisCluster.
• Maintain Java (JNA) and Python bindings to the core C++ library, ensuring API parity and correct memory/lifecycle semantics across language boundaries.
• Maintain and evolve service discovery, including DNS-based dynamic endpoint resolution with change detection and REST API-based publisher configuration discovery.
• Develop and maintain partition logic, including hostname-aware Kafka/Pulsar partition assignment for Kubernetes Stateful Set-scaled consumer pods.
• Implement and optimise performance-critical utilities, including lock-free circular buffers, time-reorder queues, CPU affinity enforcement for messaging threads, and ZSTD compression with custom dictionary support.
• Maintain the Redis client library, including cluster-aware connection management, RESP protocol handling, and health statistics reporting.
• Own the HTTP REST server and client components, including the OpenAPI-based code generation pipeline.
• Define and enforce the Protobuf message schema used for inter-component event serialization, while managing schema evolution and backward compatibility.
• Maintain a flow-based traffic filtering library for targeted data delivery to downstream consumers.
• Write and maintain comprehensive unit and integration tests across C++, Java, and Python language bindings.
• Work closely with consuming teams including Capture, Protocol Analysis, and Decryption teams to evolve the library APIs in response to new requirements without impacting existing consumers.
• Participate in code reviews, architecture discussions, and technical design sessions.
• Create, maintain, and update technical documentation, operational procedures, and development guidelines.
• Ensure platform performance, scalability, reliability, and maintainability across all supported messaging backends.
• Troubleshoot complex issues related to messaging, serialization, service discovery, networking, and distributed systems environments.

Expertise You'll Bring:

• Strong experience in designing and developing distributed messaging systems and high-performance event-driven platforms.
• Deep expertise in C++ development, including multithreading, concurrency, memory management, and low-latency system design.
• Hands-on experience with messaging technologies such as Apache Kafka, Apache Pulsar, ZeroMQ, Redis, and Redis Cluster.
• Proficiency in developing and maintaining cross-language integrations and bindings for C++, Java, and Python environments.
• Strong understanding of Pub/Sub architectures, service discovery, distributed communication patterns, and scalable microservices ecosystems.
• Experience with Protobuf schema design, serialization frameworks, schema evolution, and backward compatibility strategies.
• Knowledge of performance optimization techniques, including lock-free data structures, CPU affinity tuning, thread management, compression algorithms, and latency reduction.
• Experience building and maintaining RESTful services, Open API specifications, API code generation pipelines, and distributed service integration.
• Familiarity with Kubernetes-based deployments, partition management, Stateful Sets, containerized environments, and cloud-native architectures.
• Strong testing, troubleshooting, and debugging skills with experience developing comprehensive unit, integration, and performance test suites.
• Proven ability to collaborate with multiple engineering teams, balancing platform stability with evolving business and technical requirements.
• Excellent communication skills with experience in architecture reviews, technical documentation, code reviews, and driving engineering best practices.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."