Senior Azure Data Engineer: Remote Cloud Pipelines

Eliassen Group; Helena (MT); Remote; USD 214,906,000 - 243,560,000; Part time

Job summary

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating data from on-prem Oracle and IBM DataStage to a cloud-based Azure data lake. You will design and build scalable data pipelines using Databricks and Data Factory.

This contract-to-hire role requires hands-on development and collaboration with architects and business partners. Remote work options apply with a W2 benefits package on contract.

Qualifications

• Strong hands-on data engineering in enterprise environments.
• Experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python/PySpark development skills.
• Experience designing and developing batch data pipelines and ETL/ELT workflows.
• Experience implementing data-quality, data-validation, and reconciliation processes.
• Knowledge of medallion or lakehouse architecture (Bronze, Silver, Gold).
• Experience with Git and CI/CD pipelines.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Migrate data and ETL workloads from on-premises Oracle/DataStage to an Azure data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Design and implement medallion architecture across Bronze, Silver, and Gold layers.
• Build data-quality, reconciliation, and validation checks into pipelines and workflows.
• Automate validation and testing to improve data reliability.
• Guide data architecture decisions, design, and engineering standards.
• Troubleshoot pipeline failures and data-quality issues.
• Collaborate with engineers, analysts, architects, and stakeholders to translate requirements.
• Participate in code reviews, documentation, testing, deployment, and CI/CD.
• Promote reusable development patterns and sound engineering practices across the team.

Skills

Azure Databricks

Azure Data Factory

SQL

Python

PySpark

CI/CD

Git

Communication

Tools

Oracle DB

DataStage

Azure DevOps

Job description

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating data from on-prem Oracle and IBM DataStage to a cloud-based Azure data lake. You will design and build scalable data pipelines using Databricks and Data Factory.

This contract-to-hire role requires hands-on development and collaboration with architects and business partners. Remote work options apply with a W2 benefits package on contract.