Data Engineer - HL7

TechDigital Group; United States; On-site; USD 100,000 - 130,000; Full time

Job summary

A leading tech company in the United States is seeking an experienced Data Engineer. The role involves designing ETL/ELT pipelines and ensuring data quality. Candidates should have over 8 years of experience in data engineering, particularly with Azure technologies and healthcare data standards. This position emphasizes strong analytical skills and the ability to handle diverse data formats.

Qualifications

• 8+ years of experience as a Data Engineer with a strong foundation in data analysis.
• Proven expertise in Azure Data Factory and related technologies.
• 5+ years of experience in healthcare data with HL7 and FHIR standards.

Responsibilities

• Design and implement ETL/ELT pipelines integrating multiple data sources.
• Create database tables and DDL scripts implementing data transformation logic.
• Ensure data quality and its impact on downstream processes.

Skills

Data engineering principles

Azure Data Factory (ADF)

SQL Development

Healthcare data and standards (HL7, FHIR)

Data validation and profiling

Python scripting

Job description

Job Details

• 8+ years of experience as a Data Engineer with a strong foundation in data analysis and data engineering principles.
• Proven expertise in Azure Data Factory (ADF) and related Azure technologies.
• Several years of experience as a SQL Developer, transitioning into a Data Engineering role.
• 5+ years of experience in healthcare data, including quality assurance, and working with HL7 and FHIR standards.
• Hands-on experience with EMR systems, especially EPIC (preferred); HL7 and FHIR experience is required.
• Designed and implemented ETL/ELT pipelines using raw XML and JSON data, integrating across multiple parallel data sources.
• Proficient in creating DDL scripts, database tables, and implementing complex logic for data transformation.
• Skilled in data validation, profiling, and Python scripting, with familiarity in handling diverse data formats (e.g., date formats).
• Experience working in various SQL development environments, including handling data arrays and using LATERAL joins for data decomposition.
• Strong understanding of the importance of data quality and its impact on downstream processes.