Remote Azure Data Engineer - Data Lake & Pipelines

Eliassen Group; Lansing (MI); Remote; USD 103,000 - 117,000; Full time

Benefits offered by this job

Medical, Dental, Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group seeks a Senior Azure Data Engineer to modernize an enterprise data platform by migrating from on-prem Oracle/DataStage to a cloud-based Azure data lake. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory.

This role requires contributing to development while guiding data architecture discussions and best practices. Your work includes ingesting data from legacy sources, implementing data-quality checks, and promoting data

Qualifications

• Experience with Azure Databricks and Azure Data Factory in enterprise environments.
• Strong SQL and Python or PySpark development skills.
• Experience designing batch ETL/ELT pipelines and data-quality processes.
• Knowledge of medallion or lakehouse architecture (Bronze, Silver, Gold).

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Migrate ETL workloads from on-prem Oracle/DataStage to Azure cloud data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Implement medallion architecture across Bronze, Silver, and Gold layers.
• Build data-quality, reconciliation, and validation checks into pipelines.
• Automate validation and testing to improve data product reliability.
• Guide data architecture decisions and engineering standards.
• Troubleshoot pipeline failures and data-quality issues.
• Collaborate with engineers, analysts, architects, and stakeholders.
• Participate in code reviews, documentation, testing, and deployment.

Skills

Azure Databricks

Azure Data Factory

SQL

Python / PySpark

Data pipelines

Medallion architecture

Data quality checks

CI/CD

Git

Problem solving

Tools

Azure DevOps

Oracle

IBM DataStage

Job description

Eliassen Group seeks a Senior Azure Data Engineer to modernize an enterprise data platform by migrating from on-prem Oracle/DataStage to a cloud-based Azure data lake. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory.

This role requires contributing to development while guiding data architecture discussions and best practices. Your work includes ingesting data from legacy sources, implementing data-quality checks, and promoting data