Senior Azure Data Engineer Remote Data Lake Pipelines

Eliassen Group; Washington (District of Columbia); Remote; USD 103,000 - 117,000; Full time

Job summary

ELIassen Group is seeking a Senior Azure Data Engineer to modernize an enterprise data platform by migrating from on-premises Oracle DataStage to an Azure data lake.

You will design, build, and optimize scalable data pipelines with Azure Databricks and Azure Data Factory, guiding architecture decisions and engineering best practices while collaborating with engineers, analysts, and business stakeholders.

Qualifications

• Proven hands-on data engineering in enterprise environments.
• Experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python/PySpark development skills.
• Experience designing batch ETL/ELT workflows and data integration.
• Knowledge of medallion/lakehouse architecture and data modeling.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Migrate data and ETL workloads from on-premises Oracle/DataStage to Azure cloud data lake.
• Build scalable ingestion, transformation, and data-processing solutions.
• Implement medallion architecture across Bronze, Silver, and Gold layers.
• Incorporate data-quality checks, validation, and testing into pipelines and workflows.

Skills

Azure Databricks

Azure Data Factory

SQL

Python or PySpark

Data pipelines

Medallion architecture

CI/CD

Git

Tools

Azure Data Factory

Delta Lake

Job description

ELIassen Group is seeking a Senior Azure Data Engineer to modernize an enterprise data platform by migrating from on-premises Oracle DataStage to an Azure data lake.

You will design, build, and optimize scalable data pipelines with Azure Databricks and Azure Data Factory, guiding architecture decisions and engineering best practices while collaborating with engineers, analysts, and business stakeholders.