Data Engineer

Valuelabs; Chennai District; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

ValueLabs is seeking a Data Engineer (Real-Time Streaming) in Chennai to design and maintain real-time data pipelines for banking/FinTech workloads. You will work on event-driven architectures, leveraging Kafka, Flink, Spark Streaming or Beam to deliver low-latency solutions.

The role requires 4+ years of experience, strong Java skills, and hands-on expertise with Docker and Kubernetes for scalable deployments. Collaboration with architects and business stakeholders is essential.

Qualifications

• 4+ years of hands-on experience in data engineering and real-time streaming.
• Strong proficiency in Java and event-driven architectures.
• Experience with Kafka, Flink, Spark Streaming or Beam for low-latency pipelines.

Responsibilities

• Design, develop, and maintain real-time streaming data pipelines.
• Build scalable event-driven architectures using Kafka and modern data platforms.
• Collaborate with architects, platform teams, and stakeholders to deliver high-performance data solutions.
• Ensure system reliability, security, compliance, and operational excellence.
• Implement monitoring, resiliency, and performance optimization for distributed services.

Skills

Java

Apache Kafka

PySpark

SQL

NoSQL Databases

Shell Scripting

Distributed Systems

CI/CD

Linux

Tools

Apache Flink

Apache Spark Streaming

Apache Beam

Docker

Kubernetes

GitHub

Jenkins

Job description

Hiring: Data Engineer (Real-Time Streaming) | Chennai

Location: Chennai
Domain: Banking / Financial Services / FinTech
Experience: 4+ Years

ValueLabs is looking for a highly skilled Data Engineer with expertise in real-time data processing, event-driven architectures, and streaming platforms to build and manage scalable, low-latency data solutions for mission-critical banking and analytics workloads.

Key Responsibilities

• Design, develop, and maintain real-time streaming data pipelines.
• Build scalable event-driven architectures using Kafka and modern data platforms.
• Collaborate with architects, platform teams, and business stakeholders to deliver high-performance data solutions.
• Ensure system reliability, security, compliance, and operational excellence.
• Implement monitoring, resiliency, and performance optimization for distributed services.

Required Skills

Java (Mandatory)
Apache Kafka
Apache Flink / Spark Streaming / Beam
Event-Driven Architecture & Real-Time Data Processing
Docker & Kubernetes
PySpark
SQL & NoSQL Databases
Linux & Shell Scripting
CI/CD Tools (GitHub, Jenkins)
Design Patterns & Distributed Systems

Preferred Skills

Redis Caching
Banking, Financial Services, or FinTech Experience
Security Engineering & Compliance Controls
Data Governance, Encryption & Data Privacy Standards
Networking Fundamentals (DNS, Proxy, ACL, Policies)

What We're Looking For

• Strong hands-on experience in real-time streaming and distributed systems.
• Expertise in designing scalable and resilient data platforms.
• Strong problem-solving, communication, and stakeholder management skills.
• Experience working in Agile environments.
• Self-driven professional with the ability to work independently and collaboratively.