Kafka Developer

Infosys; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Infosys in Hyderabad seeks a skilled Kafka streaming specialist to design, implement, and support high-throughput streaming solutions. You will configure topics, partitions, retention, and compaction, while ensuring reliability and proactive maintenance.

The role focuses on reducing consumer lag and optimizing broker performance. You will collaborate with engineering teams to align configurations with best practices for scalability and resilience, and document runbooks and patterns for

Qualifications

• Kafka streaming experience is required.
• Ability to design and implement streaming pipelines.
• Experience with cluster management, monitoring, and tuning.
• Knowledge of best practices for multi-tenant adoption.

Responsibilities

• Design, implement, and support Kafka-based streaming solutions for high-throughput, low-latency workloads.
• Configure and manage topics, partitions, replication, retention, and compaction policies aligned to application needs.
• Ensure cluster reliability and availability through capacity planning, upgrades, patching, and proactive maintenance.
• Troubleshoot production issues including consumer lag, broker performance, rebalancing, and message delivery concerns.
• Define and enforce standards for naming, ACLs, quotas, and multi-tenant usage to ensure safe platform adoption.
• Implement monitoring and alerting for Kafka health, throughput, latency, and storage using metrics and logs.
• Partner with engineering teams to guide producer/consumer configurations and best practices for scalability and resilience.
• Drive performance tuning across brokers and clients, including partition strategy and batching/compression settings.
• Document operational runbooks, architecture patterns, and onboarding guidelines for consistent usage across teams.

Skills

Kafka

Streaming

Monitoring

Troubleshooting

Performance tuning

AWS

Education

MCA

MTech

Bachelor of Engineering

BCA

BTech

Tools

Amazon Managed Streaming for Apache Kafka

Job description

Roles Responsibilities

• Design, implement, and support Kafka-based streaming solutions for high-throughput, low-latency workloads.
• Configure and manage topics, partitions, replication, retention, and compaction policies aligned to application needs.
• Ensure cluster reliability and availability through capacity planning, upgrades, patching, and proactive maintenance.
• Troubleshoot production issues including consumer lag, broker performance, rebalancing, and message delivery concerns.
• Define and enforce standards for naming, ACLs, quotas, and multi-tenant usage to ensure safe platform adoption.
• Implement monitoring and alerting for Kafka health, throughput, latency, and storage using metrics and logs.
• Partner with engineering teams to guide producer/consumer configurations and best practices for scalability and resilience.
• Drive performance tuning across brokers and clients, including partition strategy and batching/compression settings.
• Document operational runbooks, architecture patterns, and onboarding guidelines for consistent usage across teams.
• Technical RequirementTechnology->Cloud Platform->AWS Data Analytics->Amazon Managed Streaming for Apache Kafka
• Educational RequirementMCA,MTech,Bachelor of Engineering,BCA,BTech
• Preferred SkillsTechnology->Cloud Platform->AWS Data Analytics->Amazon Managed Streaming for Apache Kafka
• Service LineCloud Infrastructure Services