Data Integration Engineer (Python + Kafka + REST APIs)

Talpro; Pune District; On-site; INR 2,031,000 - 2,433,000; Full time

Job summary

Talpro is seeking a Data Integration Engineer to join our hybrid team in Pune. You will design and implement scalable data integration solutions using Python, Kafka, and REST APIs to support real-time and batch pipelines.

The role emphasizes event-driven architectures, distributed data systems, and close collaboration with cross-functional teams in an Agile SDLC. Immediate joining is preferred for a 6-month contract.

Qualifications

• 5+ years of experience in data integration.
• Hands-on Python for data pipelines and transformations.
• Proven Kafka experience.
• Experience with API integrations and data orchestration.
• Understanding of real-time and batch data processing.

Responsibilities

• Design scalable data integration solutions across systems.
• Build real-time and batch data pipelines.
• Develop Python-based integration and transformation logic.
• Collaborate with cross-functional teams; follow Agile SDLC.

Skills

Data integration

Python

Kafka

REST APIs

Event-driven

Distributed systems

Job description

Talpro is leading the way in transforming the talent acquisition landscape. We deliver innovative, sustainable, and cost-effective recruitment solutions tailored to today’s business needs. Our mission is to offer comprehensive hiring strategies that address immediate recruitment demands while laying the groundwork for long-term success.

Job Description

Experience: 5+ Years

Work Mode: Hybrid

Shift: UK Hours

Contract Duration: 6 Months

Budget: INR 2 LPM

Joining: Immediate Joiners Only

Role Overview

We are seeking a Data Integration Engineer with strong hands-on expertise in Python, Kafka, REST APIs, and data integration frameworks.

This role focuses on building scalable, event-driven data pipelines and integration solutions across enterprise systems. The ideal candidate should have experience in real-time data processing, API integrations, and distributed data systems.

Key Responsibilities

Data Integration & Architecture (Core Focus)

Design and implement scalable data integration solutions across multiple systems.

Build and maintain real-time and batch data pipelines.

Ensure high performance, scalability, and reliability of data systems.

Python & API Development

Develop and maintain Python-based integration and transformation logic.

Build and consume REST APIs for system integrations.

Implement data validation, transformation, and orchestration workflows.

Work with structured and unstructured data across multiple sources.

Design and optimize data models and data flows.

Implement efficient data processing and transformation pipelines.

Delivery & Collaboration

Collaborate with cross-functional teams for requirement gathering and solution delivery.

Follow Agile SDLC practices.

Maintain code using GIT and version control best practices.

Ensure proper documentation of integration and data workflows.

Mandatory Skills

Strong experience in Data Integration

Hands-on expertise in Python (data pipelines & transformations)

Strong experience with Kafka (mandatory)

Strong knowledge of REST APIs

Experience with event-driven architecture

Strong understanding of distributed systems

Good to Have

Experience with cloud platforms (AWS / Azure / GCP)

Exposure to ETL tools and frameworks

Experience with SQL and data modeling

Soft Skills

Strong problem-solving and analytical mindset

Ability to work independently and in teams

Good communication and stakeholder management