Azure Data Engineer — Remote Cloud Pipelines & Lakehouse

Eliassen Group; Annapolis (MD); Remote; USD 214,906,000 - 243,560,000; Full time

Benefits offered by this job

Medical

Dental

Vision

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating on-premises data to an Azure cloud data lake architecture. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, and contribute to data architecture decisions and engineering best practices.

The role focuses on ingesting data from legacy systems, implementing data-quality checks, and promoting data through medallion architecture

Qualifications

• Strong hands-on data engineering experience in enterprise environments.
• Demonstrated experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python or PySpark development skills.
• Experience designing and developing batch data pipelines and ETL/ELT workflows.
• Experience implementing data-quality, data-validation, and reconciliation processes.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Support the migration of data and ETL workloads from on-premises Oracle and DataStage to Azure cloud data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Design and implement medallion architecture across Bronze, Silver, and Gold data layers.
• Build data-quality, reconciliation, and validation checks into data pipelines and workflows.
• Automate validation and testing to improve reliability of data products.
• Guide technical discussions related to data architecture and engineering standards.
• Troubleshoot pipeline failures and data-quality issues.
• Collaborate with engineers, analysts, architects, and stakeholders to translate requirements into data solutions.
• Participate in code reviews, documentation, testing, deployment, and CI/CD practices.
• Promote reusable development patterns and sound engineering practices.

Skills

Azure Databricks

Azure Data Factory

SQL

Python

PySpark

Data pipelines

Medallion architecture

Data quality

Data modeling

Git

Tools

Oracle

IBM DataStage

Job description

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating on-premises data to an Azure cloud data lake architecture. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, and contribute to data architecture decisions and engineering best practices.

The role focuses on ingesting data from legacy systems, implementing data-quality checks, and promoting data through medallion architecture