Senior Azure Data Engineer — Cloud Data Lake Pipelines (Remote)

Eliassen Group; Phoenix (AZ); Remote; USD 103,000 - 117,000; Part time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

401k with match

Life insurance

Job summary

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating workloads from on-prem Oracle/DataStage to an Azure data lake. You will design scalable pipelines using Azure Databricks and Data Factory, contributing to architecture discussions and best practices.

The role emphasizes hands-on development plus guidance on data architecture, with experience in healthcare or finance data a plus.

Qualifications

• Strong hands-on data engineering experience in enterprise environments.
• Demonstrated experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python or PySpark development skills.
• Experience designing and developing batch data pipelines and ETL/ELT workflows.
• Experience implementing data-quality, data-validation, and reconciliation processes.
• Knowledge of medallion or lakehouse architecture, including Bronze, Silver, and Gold data layers.
• Experience working with relational databases and large, complex datasets.
• Understanding of data modeling, schema design, partitioning, and performance optimization.
• Experience with Git or another version-control platform.
• Experience working with CI/CD and automated deployment practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Ability to contribute directly to development while providing technical guidance to other team members.
• Strong communication and collaboration skills.
• Preferred: healthcare/finance data, Azure DevOps, Agile/Scrum, regulated environments.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Support the migration of data and ETL workloads from on-premises Oracle and DataStage to an Azure cloud data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Design and implement medallion architecture patterns across Bronze, Silver, and Gold data layers.
• Build data-quality, reconciliation, and validation checks into data pipelines and workflows.
• Automate validation and testing to improve the reliability of data products.
• Guide technical discussions and decisions related to data architecture and engineering standards.
• Troubleshoot pipeline failures, data-quality issues, and performance problems.
• Collaborate with engineers, analysts, architects, and business stakeholders to translate requirements into data solutions.
• Participate in code reviews, documentation, testing, deployment, and continuous improvement.
• Promote reusable development patterns and sound engineering practices.

Skills

Azure Databricks

Azure Data Factory

SQL

Python

ETL/ELT

Data modeling

CI/CD

Git

Troubleshooting

Communication

Tools

Azure Databricks

Azure Data Factory

DataStage

Oracle

Job description

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating workloads from on-prem Oracle/DataStage to an Azure data lake. You will design scalable pipelines using Azure Databricks and Data Factory, contributing to architecture discussions and best practices.

The role emphasizes hands-on development plus guidance on data architecture, with experience in healthcare or finance data a plus.