Remote Azure Data Engineer: Data Lake & Pipelines

Eliassen Group; Madison (WI); Remote; USD 185,976,000 - 214,906,000; Full time

Job summary

Eliassen Group is seeking an experienced Azure Data Engineer to modernize an enterprise data platform by migrating from on-prem Oracle/DataStage to a cloud-based Azure lakehouse. You will design and build scalable pipelines using Databricks and Data Factory, implement data quality checks, and promote data through Bronze, Silver, and Gold layers.

Collaborate with engineers, analysts, and business partners to deliver trusted data products.

Qualifications

• Hands-on data engineering in enterprise environments.
• Experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python/PySpark development skills.
• Experience designing batch data pipelines and ETL/ELT workflows.
• Knowledge of medallion or lakehouse architecture (Bronze-Silver-Gold).
• Experience with CI/CD and version control (Git).

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Migrate data and ETL workloads from on-prem Oracle/DataStage to Azure cloud lake.
• Develop scalable ingestion, transformation, and processing solutions.
• Implement medallion architecture across Bronze, Silver, Gold layers.
• Build data-quality, reconciliation, and validation checks into pipelines.

Skills

Azure Databricks

Azure Data Factory

SQL

Python/PySpark

Medallion architecture

Data pipelines

Data quality

Tools

Git

CI/CD

Azure DevOps

Delta Lake

Databricks

DataStage

Job description

Eliassen Group is seeking an experienced Azure Data Engineer to modernize an enterprise data platform by migrating from on-prem Oracle/DataStage to a cloud-based Azure lakehouse. You will design and build scalable pipelines using Databricks and Data Factory, implement data quality checks, and promote data through Bronze, Silver, and Gold layers.

Collaborate with engineers, analysts, and business partners to deliver trusted data products.