Remote Senior Azure Data Engineer – Lakehouse Pipelines

Eliassen Group; Honolulu (HI); Remoto; USD 103.000 - 117.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical benefits

Dental benefits

Vision benefits

401(k) with company match

Life insurance

Descrizione del lavoro

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating data and workloads from on-premises Oracle and IBM DataStage to a cloud-based Azure data lake architecture. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, contributing to architecture decisions and engineering best practices.

You will collaborate with engineers, architects, analysts, and business partners to deliver trusted

Competenze

• Experience migrating on-premises Oracle/DataStage to Azure cloud.
• Strong SQL and Python or PySpark development.
• Experience designing batch ETL/ELT workflows and data-quality checks.
• Knowledge of medallion or lakehouse architecture (Bronze/Silver/Gold).
• Hands-on data engineering in enterprise environments.

Mansioni

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Support migration of data/ETL workloads from on-premises Oracle/DataStage to Azure data lake.
• Develop scalable ingestion, transformation and data-processing solutions.
• Implement medallion architecture across Bronze, Silver, and Gold layers.
• Build data-quality, reconciliation and validation checks into pipelines.
• Automate validation and testing to improve data reliability.
• Guide data-architecture decisions and engineering standards.
• Troubleshoot pipeline failures and performance issues.
• Collaborate with engineers, analysts, architects, and stakeholders to translate requirements.
• Participate in code reviews, documentation, testing, and deployment cycles.
• Promote reusable development patterns and sound engineering practices.

Conoscenze

Azure Databricks

Azure Data Factory

SQL

Python/PySpark

Data pipelines

Strumenti

Git

CI/CD

Azure DevOps

Descrizione del lavoro

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating data and workloads from on-premises Oracle and IBM DataStage to a cloud-based Azure data lake architecture. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, contributing to architecture decisions and engineering best practices.

You will collaborate with engineers, architects, analysts, and business partners to deliver trusted