Remote Senior Azure Data Engineer — Medallion Lakehouse

Able Too Work; Madison (WI); Remote; USD 103,000 - 117,000; Full time

Benefits offered by this job

Medical, Dental, Vision benefits

401k with company matching

Life insurance

Job summary

Able Too Work seeks a Senior Azure Data Engineer to modernize an enterprise data platform by migrating from on-prem Oracle/DataStage to a cloud-based Azure data lake. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, guiding data-architecture decisions and engineering best practices.

Responsibilities include data ingestion, quality checks, medallion architecture, and collaboration with engineers, analysts, and business partners to deliver

Qualifications

• Strong hands-on data engineering experience in enterprise environments.
• Demonstrated experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python or PySpark development skills.
• Experience designing and developing batch data pipelines and ETL/ELT workflows.
• Experience implementing data-quality, data-validation, and reconciliation processes.
• Knowledge of medallion or lakehouse architecture, Bronze/Silver/Gold layers.
• Experience with CI/CD and automated deployment practices.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Support migration of data and ETL workloads to the Azure cloud data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Design and implement medallion architecture patterns across data layers.
• Build data-quality, reconciliation, and validation checks into pipelines.
• Automate validation and testing to improve reliability of data products.
• Guide data architecture decisions and engineering standards.
• Troubleshoot pipeline failures and performance issues.
• Collaborate with engineers, analysts, architects, and stakeholders on solutions.
• Participate in code reviews, documentation, testing, deployment, and CI/CD.

Skills

SQL

Python

PySpark

Data pipelines

ETL/ELT

CI/CD

Git

Tools

Azure Databricks

Azure Data Factory

Oracle

Medallion architecture

Job description

Able Too Work seeks a Senior Azure Data Engineer to modernize an enterprise data platform by migrating from on-prem Oracle/DataStage to a cloud-based Azure data lake. You will design, build, and optimize scalable data pipelines using Azure Databricks and Azure Data Factory, guiding data-architecture decisions and engineering best practices.

Responsibilities include data ingestion, quality checks, medallion architecture, and collaboration with engineers, analysts, and business partners to deliver