Azure Data Engineer — Remote Data Lake Pipelines

Eliassen Group; Little Rock (AR); Remote; USD 90,000 - 103,000; Full time

Benefits offered by this job

Medical, Dental, Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking an Azure Data Engineer for a contract role focused on modernizing an enterprise data platform. You will migrate data and workloads from on-prem Oracle and IBM DataStage to an Azure data lake using Databricks and Data Factory, building scalable pipelines and medallion architecture.

Collaboration across engineers, analysts, and business partners is essential. Strong Azure data engineering skills, data quality, and validation expertise are the primary priorities for this

Qualifications

• Hands-on data engineering in enterprise environments.
• Demonstrated experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python or PySpark development skills.
• Experience designing and developing batch data pipelines and ETL/ELT workflows.
• Experience implementing data-quality, data-validation, and reconciliation processes.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Support migration of data and ETL workloads from on-premises Oracle and DataStage to Azure cloud data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Design and implement medallion architecture across Bronze, Silver, and Gold data layers.
• Build data-quality, reconciliation, and validation checks into pipelines and workflows.
• Automate validation and testing to improve reliability of data products.
• Troubleshoot pipeline failures, data-quality issues, and performance problems.
• Collaborate with engineers, analysts, architects, and stakeholders to translate requirements into data solutions.
• Participate in code reviews, documentation, testing, deployment, and continuous-improvement activities.
• Promote reusable development patterns and sound engineering practices across the team.

Skills

Azure Databricks

Azure Data Factory

SQL

Python

PySpark

ETL/ELT

Medallion architecture

Data quality checks

Data modeling

Git

CI/CD

Azure DevOps

DataStage

Cloud migration

Tools

Git

Azure DevOps

DataStage

Job description

Eliassen Group is seeking an Azure Data Engineer for a contract role focused on modernizing an enterprise data platform. You will migrate data and workloads from on-prem Oracle and IBM DataStage to an Azure data lake using Databricks and Data Factory, building scalable pipelines and medallion architecture.

Collaboration across engineers, analysts, and business partners is essential. Strong Azure data engineering skills, data quality, and validation expertise are the primary priorities for this