Remote Azure Data Engineer – Cloud Data Platform & Pipelines

Eliassen Group; Dover (DE); A distancia; USD 103.000 - 117.000; A tiempo parcial

Ventajas ofrecidas por este puesto de trabajo

Medical benefits

Dental benefits

Vision benefits

401k with match

Life insurance

Descripción de la vacante

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating from on-premises Oracle and IBM DataStage to an Azure data lake architecture. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, contribute to architecture decisions, and promote best practices.

This is a contract-to-hire opportunity with W2 benefits and a competitive rate.

Formación

• Hands-on data engineering in enterprise environments.
• Experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python or PySpark development skills.
• Experience designing batch data pipelines and ETL/ELT workflows.
• Knowledge of medallion or lakehouse architecture.
• Experience with relational databases and large datasets.
• Understanding of data modeling, schema design, partitioning, and performance.
• Experience with Git or another version-control platform.
• Experience with CI/CD and automated deployment practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Ability to contribute to development while guiding teammates.
• Strong communication and collaboration skills.
• Preferred: healthcare or finance data and regulated environments.

Responsabilidades

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Support migration of on-premises Oracle/DataStage workloads to an Azure data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Design and implement medallion architecture across Bronze, Silver, and Gold layers.
• Build data-quality, reconciliation, and validation checks into pipelines and workflows.
• Automate validation and testing to improve data product reliability.
• Help guide discussions on data architecture and engineering standards.
• Troubleshoot pipeline failures and data-quality issues.
• Collaborate with engineers, analysts, architects, and stakeholders to translate requirements into solutions.
• Participate in code reviews, documentation, testing, deployment and continuous improvement.

Conocimientos

Azure Databricks

Azure Data Factory

SQL

Python/PySpark

ETL/ELT design

Data pipelines

Herramientas

Git

CI/CD

Delta Lake

Databricks

Descripción del empleo

Eliassen Group is seeking a Senior Azure Data Engineer to help modernize an enterprise data platform by migrating from on-premises Oracle and IBM DataStage to an Azure data lake architecture. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, contribute to architecture decisions, and promote best practices.

This is a contract-to-hire opportunity with W2 benefits and a competitive rate.