Senior Integration Data Engineer

Algoworks; India; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Algoworks, a global AI and data engineering firm, seeks a Senior Data Integration Engineer to design, implement and operate reliable data integrations across cloud and on-premise systems.

You will build production-grade pipelines, ensure data consistency, traceability and seamless processing using Python, SQL and modern API/data formats. Strong collaboration with engineering teams is essential.

Qualifications

• 9+ years of experience building and operating production-grade data integrations.
• Strong hands-on experience with Python and SQL.
• Experience working with REST APIs and data formats such as XML and JSON.
• Strong understanding of batch processing and change-data processing.
• Experience developing integration adapters and transformation workflows.
• Hands-on experience with automated testing, logging, retries and replay mechanisms.
• Ability to troubleshoot and trace data across multiple services and processing layers.

Responsibilities

• Design and implement source-to-application integrations, adapters and data transformation workflows.
• Develop and maintain batch and change-data processing pipelines using Python and SQL.
• Work with APIs, XML/JSON and integration services to enable reliable data exchange.
• Ensure record identity, data consistency and compatibility with existing applications.
• Implement robust logging, monitoring, retries, error handling and replay mechanisms.
• Develop automated tests and validate integrations across multiple services.
• Troubleshoot end-to-end data flows and trace individual records across systems.
• Evaluate and recommend whether to modify existing applications, introduce adapters, or use shared data models.
• Collaborate with engineering teams to ensure reliable, maintainable and production-ready integration solutions.

Skills

Python

SQL

REST APIs

XML/JSON

Batch processing

Change-data processing

Integration adapters

Data transformations

Automated testing

Logging

Retry and replay

Troubleshooting data flows

Tools

AWS Cloud services

RabbitMQ

MongoDB

Solr

Job description

Algoworks is an award-winning artificial intelligence, engineering services and experience transformation firm with offices across the United States, Europe, South America and India. We bring together a global team of engineers, architects, designers, researchers and operators united by rigor, accountability and a commitment to delivering measurable results.

For over 20 years, Algoworks has partnered with Fortune 500 organizations across the Americas, Europe and Asia to define, build and run technology that drives meaningful business outcomes. Our work combines human-centered design, engineering excellence and AI-powered capabilities to solve complex challenges with clarity and precision. Innovation, particularly in the responsible application of AI, is embedded in how teams approach problem-solving and continuous improvement.

At Algoworks, growth is continuous and closely tied to impact. Teams collaborate across geographies and disciplines, strengthening outcomes through shared insight and collective expertise. The culture values transparency, open dialogue and an environment where every voice is heard and contribution is recognized.

Through collaboration, accountability and a focus on results, Algoworks operates at the intersection of technology and people, building not only advanced systems but strong global teams that elevate performance and create lasting impact.

Follow the video below to know about us! Clipchamp

Role overview

We are looking for a Senior Data Integration Engineer to design, implement and operate reliable integrations between a cloud data platform and an established data-processing application. The role will focus on building production-grade integration solutions, ensuring data consistency, compatibility, traceability and seamless processing across multiple services.

Key responsibilities:

• Design and implement source-to-application integrations, adapters and data transformation workflows.
• Develop and maintain batch and change-data processing pipelines using Python and SQL.
• Work with APIs, XML/JSON and integration services to enable reliable data exchange.
• Ensure record identity, data consistency and compatibility with existing applications.
• Implement robust logging, monitoring, retries, error handling and replay mechanisms.
• Develop automated tests and validate integrations across multiple services.
• Troubleshoot end-to-end data flows and trace individual records across systems.
• Evaluate and recommend whether to modify existing applications, introduce adapters, or use shared data models.
• Collaborate with engineering teams to ensure reliable, maintainable and production-ready integration solutions.

Required skills and qualifications:

• 9+ years of experience building and operating production-grade data integrations.
• Strong hands-on experience with Python and SQL.
• Experience working with REST APIs and data formats such as XML and JSON.
• Strong understanding of batch processing and change-data processing.
• Experience developing integration adapters and transformation workflows.
• Hands-on experience with automated testing, logging, retries and replay mechanisms.
• Ability to troubleshoot and trace data across multiple services and processing layers.

Must have skills:

• Python and SQL
• API and data processing
• XML/JSON
• Batch and change-data processing
• Integration adapters and data transformations
• Automated testing
• Error handling, logging, retry and replay
• Strong understanding of end-to-end data flow and record traceability

Good to have skills:

• Experience with AWS Cloud services.
• Hands-on experience with RabbitMQ.
• Experience with MongoDB and Solr.
• Knowledge of cloud-based data platforms and distributed systems.
• Familiarity with CI/CD and DevOps practices.

Desired attributes:

• Strong problem-solving and troubleshooting skills.
• Ability to make sound architectural decisions around adapters, application changes and shared models.
• Strong focus on data accuracy, reliability and system compatibility.
• Excellent communication and collaboration skills.
• Ability to work independently and take end-to-end ownership of integration solutions.
• Strong engineering mindset with a focus on maintainability, testability and production readiness.