Data engineer

Nityo Infotech Corporation; United States; Remote; USD 120,000 - 150,000; Full time

Job summary

A leading technology company is seeking a Data Engineer with over 8 years of experience. The role involves working with healthcare data and requires expertise in Azure Data Factory and SQL. Ideal candidates will have hands-on experience with EMR systems and be proficient in Python scripting. Strong understanding of data quality and engineering principles is essential for this position.

Qualifications

• 8+ years of experience as a Data Engineer with strong data analysis and engineering principles.
• Proven expertise in Azure Data Factory and related technologies.
• Experience with healthcare data, including quality assurance and HL7/FHIR standards.

Skills

Data analysis

Healthcare data

SQL Development

Python scripting

Data quality awareness

Tools

Azure Data Factory (ADF)

EMR systems (EPIC)

Snowflake

Selenium WebDriver

Job description

Data engineer

Remote

Required Qualifications

8+ years of experience as a Data Engineer with a strong foundation in data analysis and data engineering principles.

5+ years of experience in healthcare data, including quality assurance, and working with HL7 and FHIR standards.

Hands-on experience with EMR systems, especially EPIC (preferred); HL7 and FHIR experience is required. Proven expertise in Azure Data Factory (ADF) and related Azure technologies.

Several years of experience as a SQL Developer, transitioning into a Data Engineering role.

Designed and implemented ETL/ELT pipelines using raw XML and JSON data, integrating across multiple parallel data sources.

Proficient in creating DDL scripts, database tables, and implementing complex logic for data transformation.

Skilled in data validation, profiling, and Python scripting, with familiarity in handling diverse data formats (e.g., date formats).

Experience working in various SQL development environments, including handling data arrays and using LATERAL joins for data decomposition.

Strong understanding of the importance of data quality and its impact on downstream processes.

Desired Skills

Extensive experience in automating web applications using Selenium WebDriver, with automation scripting in Python.

Hands-on experience with Snowflake for data warehousing and analytics.

Exposure to multiple testing domains including:

• Functional testing
• Data integrity
• Security and privacy validation
• Regression testing
• Ongoing data quality monitoring and tracking