Senior Azure Data Engineer - Remote Cloud Data Lake

Eliassen Group; Hagåtña (GU); Remote; USD 103,000 - 117,000; Full time

Benefits offered by this job

Medical, Dental, and Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking a Senior Azure Data Engineer to remotely modernize an enterprise data platform by migrating data from on-prem Oracle/DataStage to an Azure cloud lake architecture. You will design, build, and optimize scalable data pipelines using Azure Databricks and Data Factory, while guiding data architecture discussions and engineering best practices.

Strong emphasis on delivering trusted data products, data quality checks, and collaboration across engineers, analysts, and business

Qualifications

• Strong hands-on data engineering experience in enterprise environments.
• Experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python or PySpark development skills.
• Experience designing and developing batch data pipelines and ETL/ELT workflows.
• Knowledge of medallion or lakehouse architecture, including Bronze, Silver, and Gold layers.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Migrate data and ETL workloads from on-premises Oracle and DataStage to Azure cloud data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Implement medallion architecture patterns across Bronze, Silver, and Gold layers.
• Build data-quality, reconciliation, and validation checks into pipelines.
• Automate validation and testing to improve data reliability.
• Guide architecture decisions and engineering standards.
• Troubleshoot pipeline failures and performance issues.
• Collaborate with engineers, analysts, architects, and stakeholders to translate requirements into data solutions.
• Participate in code reviews, documentation, testing, deployment, and CI/CD.

Skills

Azure Databricks

Azure Data Factory

SQL

Python

PySpark

Batch pipelines

Tools

Git

Azure DevOps

CI/CD

Job description

Eliassen Group is seeking a Senior Azure Data Engineer to remotely modernize an enterprise data platform by migrating data from on-prem Oracle/DataStage to an Azure cloud lake architecture. You will design, build, and optimize scalable data pipelines using Azure Databricks and Data Factory, while guiding data architecture discussions and engineering best practices.

Strong emphasis on delivering trusted data products, data quality checks, and collaboration across engineers, analysts, and business