Data Engineer – Flink

D4 Insight; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

D4 Insight is seeking a Data Engineer with Apache Flink to build high-performance streaming solutions for enterprise banking systems.

You will design scalable data pipelines, stream processing frameworks, and distributed data platforms for secure, real-time data processing. We craft, deploy, and manage bespoke services in CRM, data and AI, cybersecurity and consulting.

Qualifications

• Experience in data engineering and building streaming systems.
• Proficient in Java or Scala for data processing.
• Knowledge of distributed data platforms and both SQL and NoSQL.
• Familiarity with CI/CD and monitoring for streaming applications.

Responsibilities

• Design and develop event-driven streaming pipelines using Apache Flink and Kafka.
• Build scalable data processing applications in Java or Scala.
• Implement distributed data solutions across SQL and NoSQL platforms.
• Deploy applications using Docker and Kubernetes.
• Implement CI/CD pipelines and monitoring for streaming apps.
• Promote engineering best practices and Agile delivery.

Skills

Data engineering

Streaming

Java

Scala

Tools

Apache Flink

Kafka

Docker

Kubernetes

Job description

We are looking for Data Engineer with expertise in Apache Flink to build high-performance, event-driven streaming solutions for enterprise banking systems. The role involves designing scalable data pipelines, stream processing frameworks, and distributed data platforms that support secure, resilient, and real-time data processing.

Key Responsibilities:

• Design and develop event-driven streaming pipelines using Apache Flink and Kafka.
• Build scalable data processing applications using Java or Scala.
• Implement distributed data solutions across SQL and NoSQL platforms.
• Optimize JVM performance and distributed processing workloads.
• Deploy applications using Docker and Kubernetes.
• Implement CI/CD pipelines and monitoring for streaming applications.
• Integrate security controls into ETL processes and data pipelines.
• Support resilient and highly available distributed services.
• Work closely with Data Engineering, DevOps, and Product teams.
• Promote engineering best practices and Agile delivery.
• Contribute to technical documentation and knowledge sharing.

We craft, deploy, and manage bespoke services in CRM, data and AI, cybersecurity and consulting.