Azure Data Engineer: Remote Cloud Data Lake & Databricks

Eliassen Group; Annapolis (MD); Remote; USD 90,000 - 103,000; Full time

Job summary

Eliassen Group is seeking an Azure Data Engineer to modernize an enterprise data platform by migrating data from on-premises Oracle and IBM DataStage to a cloud-based Azure lakehouse. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, implement data-quality checks, and promote data through medallion architecture layers.

Collaboration with engineers and business partners is key.

Qualifications

• Hands-on data engineering experience in enterprise environments.
• Demonstrated experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python or PySpark development skills.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Support the migration of data and ETL workloads from on‑premises Oracle/DataStage to Azure data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Design and implement medallion architecture patterns across Bronze, Silver, and Gold data layers.
• Build data-quality, reconciliation, and validation checks directly into data pipelines.
• Automate validation and testing to improve reliability of data products.
• Troubleshoot pipeline failures, data-quality issues, and performance problems.
• Collaborate with engineers, analysts, architects, and business stakeholders to translate requirements into data solutions.
• Participate in code reviews, documentation, testing, deployment, and continuous-improvement activities.
• Promote reusable development patterns and sound engineering practices across the team.

Skills

Azure Databricks

Azure Data Factory

SQL

Python / PySpark

ETL / ELT pipelines

Medallion architecture

Data quality checks

CI/CD

Tools

Git

Azure DevOps

Delta Lake

Job description

Eliassen Group is seeking an Azure Data Engineer to modernize an enterprise data platform by migrating data from on-premises Oracle and IBM DataStage to a cloud-based Azure lakehouse. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, implement data-quality checks, and promote data through medallion architecture layers.

Collaboration with engineers and business partners is key.