Algoworks - Senior Integration Data Engineer

Algoworks

Itanagar

On-site

INR 2,400,000 - 4,800,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Algoworks is seeking an experienced Senior Integration Data Engineer to design, develop, and manage reliable data integrations between cloud-based data platforms and existing processing applications.

The ideal candidate has strong Python and SQL skills, solid API experience, and a proven ability to build production-grade integrations ensuring data accuracy, traceability, and reliability across multiple services.

Qualifications

  • 10+ years of total experience in data integration and data engineering.
  • Strong hands-on experience with Python and SQL.
  • Experience with REST APIs and data formats such as XML and JSON.
  • Strong understanding of batch processing and change-data processing.
  • Experience developing integration adapters and data transformation workflows.
  • Hands-on experience with automated testing, logging, retries and replay mechanisms.
  • Ability to troubleshoot and trace data across multiple services and processing layers.
  • Focus on data consistency and end-to-end data traceability.

Responsibilities

  • Design and implement source-to-application integrations, integration adapters and data transformation workflows.
  • Develop and maintain batch-processing and change-data-processing pipelines using Python and SQL.
  • Work with REST APIs, XML, JSON and integration services to enable seamless data exchange.
  • Ensure record identity, data consistency and compatibility across existing applications and systems.
  • Implement robust logging, monitoring, retry, error-handling and replay mechanisms.
  • Develop automated tests and validate integrations across multiple services.
  • Troubleshoot end-to-end data flows and trace individual records across different systems and processing layers.
  • Evaluate and recommend appropriate integration approaches, including application modifications, integration adapters and shared data models.
  • Collaborate with cross-functional engineering teams to deliver reliable, scalable and maintainable integration solutions.
  • Ensure production readiness, system reliability and maintainability of integration workflows.

Skills

Python
SQL
REST APIs
Data transformation
Batch processing
Data tracing

Tools

AWS
RabbitMQ
MongoDB
Solr

Job description

Job Description

We are looking for an experienced Senior Integration Data Engineer to design, develop and manage reliable data integrations between cloud-based data platforms and existing data-processing applications.

The ideal candidate will have strong expertise in Python, SQL, APIs and data transformation, with the ability to build production-grade integration solutions that ensure data accuracy, consistency, compatibility and traceability across multiple systems.

Total Experience

10+ years

Key Responsibilities
  • Design and implement source-to-application integrations, integration adapters and data transformation workflows.
  • Develop and maintain batch-processing and change-data-processing pipelines using Python and SQL.
  • Work with REST APIs, XML, JSON and integration services to enable seamless data exchange.
  • Ensure record identity, data consistency and compatibility across existing applications and systems.
  • Implement robust logging, monitoring, retry, error-handling and replay mechanisms.
  • Develop automated tests and validate integrations across multiple services.
  • Troubleshoot end-to-end data flows and trace individual records across different systems and processing layers.
  • Evaluate and recommend appropriate integration approaches, including application modifications, integration adapters and shared data models.
  • Collaborate with cross-functional engineering teams to deliver reliable, scalable and maintainable integration solutions.
  • Ensure production readiness, system reliability and maintainability of integration workflows.
Required Skills & Qualifications
  • 9+ years of experience building and managing production-grade data integrations (overall role requirement : 10+ years).
  • Strong hands-on experience with Python and SQL.
  • Experience working with REST APIs and data formats such as XML and JSON.
  • Strong understanding of batch processing and change-data processing.
  • Experience developing integration adapters and data transformation workflows.
  • Hands-on experience with automated testing, logging, retries and replay mechanisms.
  • Ability to troubleshoot and trace data across multiple services and processing layers.
  • Strong understanding of data consistency, record identity and end-to-end data traceability.
Good To Have Skills
  • Experience with AWS cloud services.
  • Hands-on experience with RabbitMQ.
  • Experience with MongoDB and Solr.
  • Knowledge of cloud-based data platforms and distributed systems.
  • Familiarity with CI/CD pipelines and DevOps practices.
Desired Competencies
  • Strong analytical, problem-solving and troubleshooting skills.
  • Ability to make sound technical and architectural decisions.
  • Focus on data accuracy, reliability and system compatibility.
  • Strong communication and collaboration skills.
  • Ability to work independently and take end-to-end ownership.
  • Focus on maintainability, testability and production readiness.
Interview Process
  • 2 rounds of discussion

(ref:hirist.tech)

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Integration Data Engineer
Senior Integration Data Engineer

Algoworks Technologies Private Limited • Dadri

On-site
INR 1,500,000 - 2,100,000
Algoworks - Senior Integration Engineer - Boomi/Airbyte
Algoworks - Senior Integration Engineer - Boomi/Airbyte

Algoworks • Dadri

On-site
INR 2,400,000 - 3,600,000
Senior Integration Lead Engineer
Senior Integration Lead Engineer

Algoworks • Dadri

On-site
INR 1,200,000 - 1,800,000
Senior Integration Lead Engineer
Senior Integration Lead Engineer

Algoworks Technologies Private Limited • Dadri

On-site
INR 1,500,000 - 2,400,000
Data Engineer
Data Engineer

Sutherland • Chennai

Remote
INR 600,000 - 1,200,000
Senior Data Engineer - Python/SQL
Senior Data Engineer - Python/SQL

India Fan Corporation • Bengaluru

On-site
INR 1,800,000 - 2,400,000
AWS Data and Integration Engineer
AWS Data and Integration Engineer

Quantum Strides LLC • Chennai

On-site
INR 800,000 - 1,200,000
Integration Specialist
Integration Specialist

Crescendo Global • Hyderabad

On-site
INR 1,500,000 - 2,000,000
Data Integration Consultant
Data Integration Consultant

Acespire Solutions • India

On-site
INR 800,000 - 1,200,000
Eucloid - Senior Data Engineer - AWS Technologies
Eucloid - Senior Data Engineer - AWS Technologies

Eucloid Data Solutions Pvt Ltd • Chennai District

On-site
INR 1,200,000 - 1,800,000