Senior Data Integration Engineer: Healthcare Data Pipelines

Algoworks; North Carolina; On-site; USD 120,000 - 160,000; Full time

Job summary

Algoworks is seeking a Senior Data Integration Engineer to design, implement, and operate reliable integrations between a cloud data platform and an established data-processing application. The role focuses on production-grade data pipelines, ensuring data consistency and traceability across services.

You will build adapters, transform data, and implement robust logging, retries, and testing to maintain end-to-end data quality and reliability.

Qualifications

• 9+ years of experience building and operating production-grade data integrations.
• Strong hands-on experience with Python and SQL.
• Experience with REST APIs and data formats such as XML and JSON.
• Strong understanding of batch processing and change-data processing.
• Experience developing integration adapters and transformation workflows.
• Hands-on experience with automated testing, logging, retries and replay mechanisms.
• Ability to troubleshoot and trace data across multiple services and processing layers.

Responsibilities

• Design and implement source-to-application integrations, adapters and data transformation workflows.
• Develop and maintain batch and change-data processing pipelines using Python and SQL.
• Work with APIs, XML/JSON and integration services to enable reliable data exchange.
• Ensure record identity, data consistency and compatibility with existing applications.
• Implement robust logging, monitoring, retries, error handling and replay mechanisms.
• Develop automated tests and validate integrations across multiple services.
• Troubleshoot end-to-end data flows and trace individual records across systems.
• Evaluate and recommend whether to modify existing applications, introduce adapters, or use shared data models.
• Collaborate with engineering teams to ensure reliable, maintainable and production-ready integration solutions.

Skills

Python

SQL

API integration

XML/JSON

Batch processing

Change-data processing

Data tracing

Testing and validation

Logging and retries

End-to-end data flow

Tools

AWS

RabbitMQ

MongoDB

Solr

Job description

Algoworks is seeking a Senior Data Integration Engineer to design, implement, and operate reliable integrations between a cloud data platform and an established data-processing application. The role focuses on production-grade data pipelines, ensuring data consistency and traceability across services.

You will build adapters, transform data, and implement robust logging, retries, and testing to maintain end-to-end data quality and reliability.