ADF Data Engineer

Compunnel, Inc.; Eden Prairie (MN); On-site; USD 80,000 - 110,000; Full time

Job summary

An innovative firm is looking for an experienced ADF Data Engineer to join their growing Center of Excellence. This role focuses on migrating ETL processes to Azure Data Factory, utilizing Snowflake as the target database. You will analyze project requirements, design data pipelines, and collaborate with a talented team of ETL developers and data modelers. If you have a passion for data engineering and want to contribute to impactful projects in the healthcare domain, this opportunity is perfect for you. Join a dynamic team and help shape the future of data solutions.

Qualifications

• 5+ years of experience in data engineering required.
• Familiarity with ETL tools like SSIS or Informatica is essential.

Responsibilities

• Design and maintain data pipelines using Azure Data Factory.
• Collaborate with team members to ensure data quality and integrity.

Skills

Data Engineering

Azure Data Factory

SQL

Snowflake

ETL Processes

Education

Bachelor's Degree in Computer Science or related field

Tools

Informatica

SSIS

Job description

We are seeking an experienced ADF Data Engineer to support a State of Alabama Medicaid Decision Support System project.

This role is part of a growing Center of Excellence (CoE) consisting of ETL Developers, Data Modelers, Architects, and Managers.

The primary objective is to migrate existing ETL processes from Informatica/SQL to Azure Data Factory with Snowflake as the target database platform.

Key Responsibilities

• Analyze project requirements and develop detailed specifications for ETL processes
• Design, build, and maintain data pipelines using Azure Data Factory (ADF)
• Work extensively with SQL-based RDBMS systems, including Snowflake
• Collaborate with team members including ETL developers, data modelers, and architects within the CoE
• Participate in data architecture discussions and propose scalable solutions
• Maintain data quality and integrity throughout the ETL lifecycle

Required Qualifications

• Minimum of 5 years of experience in data engineering
• Familiarity with other ETL tools such as SSIS or Informatica
• Experience working with relational databases

Preferred Qualifications

• Prior experience in the healthcare domain, especially with state-level projects
• Hands-on experience with Snowflake as a data platform