Remote Azure Data Engineer | Databricks & Lakehouse

Eliassen Group; Topeka (KS); Remote; USD 103.000 - 117.000; Teilzeit

Benefits dieser Stelle

Medical benefits

Dental benefits

Vision benefits

401k with company match

Life insurance

Zusammenfassung

Eliassen Group seeks a Senior Azure Data Engineer to modernize an enterprise data platform by migrating from on-prem Oracle/DataStage to an Azure data lake using Databricks and Data Factory.

You will design, build, and optimize scalable data pipelines, contribute to architecture decisions, and collaborate across engineering, analytics, and business teams. This remote contract-to-hire role emphasizes data quality and governance.

Qualifikationen

• Extensive hands-on data engineering in enterprise environments.
• Strong experience with Azure Databricks and Azure Data Factory.
• Proficient in SQL and Python/PySpark, plus batch ETL/ELT design.

Aufgaben

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Migrate ETL workloads from on-prem Oracle/DataStage to Azure cloud data lake.
• Build scalable data ingestion, transformation, and processing solutions.
• Implement medallion architecture across Bronze, Silver, Gold layers.
• Embed data quality, reconciliation, and validation checks in pipelines and workflows.
• Automate validation/testing to improve reliability of data products.
• Guide data architecture discussions and engineering standards.
• Troubleshoot pipeline failures and data-quality issues.
• Collaborate with engineers, analysts, and business stakeholders to translate requirements into solutions.
• Participate in code reviews, documentation, deployment, and CI/CD.
• Promote reusable development patterns and sound engineering practices.

Kenntnisse

Azure Databricks

Azure Data Factory

SQL

Python/PySpark

ETL/ELT design

Medallion architecture

Data quality

CI/CD

Git

Healthcare data

Tools

Azure DevOps

DataStage

Oracle

Jobbeschreibung

Eliassen Group seeks a Senior Azure Data Engineer to modernize an enterprise data platform by migrating from on-prem Oracle/DataStage to an Azure data lake using Databricks and Data Factory.

You will design, build, and optimize scalable data pipelines, contribute to architecture decisions, and collaborate across engineering, analytics, and business teams. This remote contract-to-hire role emphasizes data quality and governance.