Remote Azure Data Engineer - Data Lakes & Pipelines

Eliassen Group; City of Albany (NY); À distance; USD 90 000 - 103 000; Plein temps

Avantages offerts par ce poste

Medical benefits

Dental benefits

Vision benefits

401k with match

Life insurance

Résumé du poste

Eliassen Group is seeking an Azure Data Engineer for a remote contract to modernize an enterprise data platform by migrating from an on-prem Oracle/DataStage stack to a cloud-based Azure data lake. You will design, build, and optimize scalable pipelines using Azure Databricks and Azure Data Factory, and promote data through medallion architecture layers.

You will collaborate with engineers, analysts, architects, and business partners to deliver trusted data products with strong data quality,

Qualifications

• Hands-on data engineering in enterprise environments.
• Strong SQL and Python or PySpark development skills.
• Experience with Azure Databricks and Azure Data Factory.
• Knowledge of medallion or lakehouse architecture (Bronze/Silver/Gold).

Responsabilités

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Migrate data and ETL workloads from on-prem Oracle/DataStage to Azure cloud lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Implement medallion architecture across Bronze, Silver, and Gold layers.
• Build data quality, reconciliation, and validation checks into pipelines.
• Collaborate with engineers, analysts, architects, and stakeholders to translate requirements.

Connaissances

SQL

Python/PySpark

ETL/ELT

Data modeling

Analytics

Outils

Azure Databricks

Azure Data Factory

Azure DevOps

Git

Description du poste

Eliassen Group is seeking an Azure Data Engineer for a remote contract to modernize an enterprise data platform by migrating from an on-prem Oracle/DataStage stack to a cloud-based Azure data lake. You will design, build, and optimize scalable pipelines using Azure Databricks and Azure Data Factory, and promote data through medallion architecture layers.

You will collaborate with engineers, analysts, architects, and business partners to deliver trusted data products with strong data quality,