Flink Developer

Ibs Corp; Thiruvananthapuram, Ernakulam, Chennai District, Bengaluru; On-site; INR 900,000 - 1,400,000; Full time

Job summary

Ibs Corp in India seeks a skilled Flink Java Developer with 3–8 years of hands-on experience to build real-time streaming applications at scale. You will work with Kafka, stateful processing, event-time semantics, and Flink PaaS concepts while ensuring high availability and fault tolerance.

The role spans design, development, deployment in cloud-native environments, and collaboration with cross-functional teams to deliver resilient data pipelines.

Qualifications

• 3–8 years of hands-on Apache Flink experience with Java.
• Strong expertise in Kafka (producer, consumer, partitioning, offset management).
• Knowledge of Flink state management (operator/keyed state, RocksDB backend).
• Experience with event-time processing, watermarks, windowing, and broadcast state.
• Solid Java development skills including concurrency, performance tuning, and memory management.

Responsibilities

• Design and develop real-time stream processing applications using Apache Flink and Java.
• Implement stateful stream processing (keyed state, operator state, checkpointing, savepoints).
• Apply event-time semantics, watermarking, and windowing for accurate streaming computations.
• Optimize Flink job performance (parallelism, operator chaining, backpressure handling, checkpointing strategy).
• Integrate with Kafka (mandatory) for ingestion and delivery pipelines.
• Tune serialization/deserialization (Kryo, Avro, Protobuf, POJO) for high throughput and efficiency.
• Implement Async I/O patterns in Flink to integrate with external systems (e.g., MongoDB/NoSQL).
• Connect pipelines to NoSQL databases (MongoDB preferred) for persistence and lookups.
• Deploy and monitor applications in cloud-native environments; exposure to Flink PaaS solutions is advantageous.
• Ensure high availability, fault tolerance, and data consistency across distributed systems.

Skills

Flink Java experience

Kafka expertise

State management

Event-time processing

Java performance tuning

Tools

MongoDB

Flink PaaS

Job description

Experience: 3-8 years
Location: [TVM / COK / CHENNAI / BLR]

Role Overview

We are looking for a highly skilled Flink Java Developer with 3–8 years of experience in building real-time streaming applications at scale. The ideal candidate will have strong hands-on expertise in Apache Flink (Java), solid working experience with Kafka, and knowledge of streaming data design patterns. Familiarity with Flink PaaS solutions (e.g., Decodable, Confluent Cloud, Kinesis Data Analytics) is a strong plus.

Key Responsibilities

• Design and develop real-time stream processing applications using Apache Flink and Java.
• Implement stateful stream processing (keyed state, operator state, checkpointing, savepoints).
• Apply event-time semantics, watermarking, and windowing for accurate streaming computations.
• Optimize Flink job performance (parallelism, operator chaining, backpressure handling, checkpointing strategy).
• Integrate with Kafka (mandatory) for ingestion and delivery pipelines.
• Tune serialization/deserialization (Kryo, Avro, Protobuf, POJO) for high throughput and efficiency.
• Implement Async I/O patterns in Flink to integrate with external systems (e.g., MongoDB/NoSQL).
• Connect pipelines to NoSQL databases (MongoDB preferred) for persistence and lookups.
• Deploy and monitor applications in cloud-native environments; exposure to Flink PaaS solutions is advantageous.
• Ensure high availability, fault tolerance, and data consistency across distributed systems.

Required Skills & Experience

• 3–8 years of hands-on Apache Flink experience with Java.
• Strong expertise in Kafka (producer, consumer, partitioning, offset management).
• Knowledge of Flink state management (operator/keyed state, RocksDB backend).
• Experience with event-time processing, watermarks, windowing, and broadcast state.
• Solid Java development skills including concurrency, performance tuning, and memory management.

Good to Have

• Experience with Flink PaaS solutions (Decodable, Confluent Cloud, Kinesis Analytics, etc.).
• Serialization tuning with Kryo, Avro, Protobuf, or POJO optimization.
• Familiarity with Async Flink operators (async lookups, async I/O).
• Experience with NoSQL databases such as MongoDB.
• Exposure to Flink metrics, job monitoring, and performance optimization.

Desired Qualities

• Strong problem-solving and debugging skills.
• Effective communication and collaboration with cross-functional teams.
• Proactive, ownership-driven approach to handling large-scale, critical data pipelines.
• Ability to adapt quickly in fast-paced, cloud-first environments.