Senior Data Integration Engineer

Algoworks; North Carolina; On-site; USD 120,000 - 160,000; Full time

Job summary

Algoworks is seeking a Senior Data Integration Engineer to design, implement, and operate reliable integrations between a cloud data platform and an established data-processing application. The role focuses on production-grade data pipelines, ensuring data consistency and traceability across services.

You will build adapters, transform data, and implement robust logging, retries, and testing to maintain end-to-end data quality and reliability.

Qualifications

• 9+ years of experience building and operating production-grade data integrations.
• Strong hands-on experience with Python and SQL.
• Experience with REST APIs and data formats such as XML and JSON.
• Strong understanding of batch processing and change-data processing.
• Experience developing integration adapters and transformation workflows.
• Hands-on experience with automated testing, logging, retries and replay mechanisms.
• Ability to troubleshoot and trace data across multiple services and processing layers.

Responsibilities

• Design and implement source-to-application integrations, adapters and data transformation workflows.
• Develop and maintain batch and change-data processing pipelines using Python and SQL.
• Work with APIs, XML/JSON and integration services to enable reliable data exchange.
• Ensure record identity, data consistency and compatibility with existing applications.
• Implement robust logging, monitoring, retries, error handling and replay mechanisms.
• Develop automated tests and validate integrations across multiple services.
• Troubleshoot end-to-end data flows and trace individual records across systems.
• Evaluate and recommend whether to modify existing applications, introduce adapters, or use shared data models.
• Collaborate with engineering teams to ensure reliable, maintainable and production-ready integration solutions.

Skills

Python

SQL

API integration

XML/JSON

Batch processing

Change-data processing

Data tracing

Testing and validation

Logging and retries

End-to-end data flow

Tools

AWS

RabbitMQ

MongoDB

Solr

Job description

Our client is a Data-Driven Healthcare Technology organization that combines EMS electronic patient care reports (ePCR) from their growing network of thousands of Emergency Medical Services (EMS) providers with other electronic healthcare data sources using proprietary artificial intelligence (AI) to support the missions of public sector and commercial healthcare entities.

We are looking for a Senior Data Integration Engineer to design, implement and operate reliable integrations between a cloud data platform and an established data-processing application. The role will focus on building production-grade integration solutions, ensuring data consistency, compatibility, traceability and seamless processing across multiple services.

Key responsibilities

• Design and implement source-to-application integrations, adapters and data transformation workflows.
• Develop and maintain batch and change-data processing pipelines using Python and SQL.
• Work with APIs, XML/JSON and integration services to enable reliable data exchange.
• Ensure record identity, data consistency and compatibility with existing applications.
• Implement robust logging, monitoring, retries, error handling and replay mechanisms.
• Develop automated tests and validate integrations across multiple services.
• Troubleshoot end-to-end data flows and trace individual records across systems.
• Evaluate and recommend whether to modify existing applications, introduce adapters, or use shared data models.
• Collaborate with engineering teams to ensure reliable, maintainable and production-ready integration solutions.

Required skills and qualifications

• 9+ years of experience building and operating production-grade data integrations.
• Strong hands-on experience with Python and SQL.
• Experience working with REST APIs and data formats such as XML and JSON.
• Strong understanding of batch processing and change-data processing.
• Experience developing integration adapters and transformation workflows.
• Hands-on experience with automated testing, logging, retries and replay mechanisms.
• Ability to troubleshoot and trace data across multiple services and processing layers.

Must have skills

• Python and SQL
• API and data processing
• XML/JSON
• Batch and change-data processing
• Integration adapters and data transformations
• Automated testing
• Error handling, logging, retry and replay
• Strong understanding of end-to-end data flow and record traceability

Good to have skills

• Experience with AWS Cloud services.
• Hands-on experience with RabbitMQ.
• Experience with MongoDB and Solr.
• Knowledge of cloud-based data platforms and distributed systems.
• Familiarity with CI/CD and DevOps practices.

Desired attributes

• Experience w/EMS (Emergency Medical Records), ePCR (Electronic Patient Care Reports) and/or electronic healthcare data technologies
• Strong problem-solving and troubleshooting skills.
• Ability to make sound architectural decisions around adapters, application changes and shared models.
• Strong focus on data accuracy, reliability and system compatibility.
• Excellent communication and collaboration skills.
• Ability to work independently and take end-to-end ownership of integration solutions.
• Strong engineering mindset with a focus on maintainability, testability and production readiness.